05/04/2026 02:14:34.181 7f7286cc4380 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/04/2026 02:14:34.181 7f7286cc4380 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/04/2026 02:14:34.181 7f7286cc4380 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/04/2026 02:14:34.191 7f7283e1fea0 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 05/04/2026 02:14:34.191 7f7283e1fea0 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 05/04/2026 02:14:34.192 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 05/04/2026 02:14:34.193 7f7283d5a2c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 05/04/2026 02:14:34.194 7f7283d5a2c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.350 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 85548829187745981269284049842348270143458873789370622071216877838141709075287, 'start': '1777860872000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 103367072946317191051567235224579240859336731882151277501252297958448352671654, 'start': '1777860872000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 26724219318725451946558030116947365684677020212617796359943207888545240069933, 'start': '1777860872000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 41755055363756212429084130615786887658309229247722786749134499522639490578412, 'start': '1777860872000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 05/04/2026 02:14:34.390 7f7286cc4380 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-5738-1', _node_type='Control', _instance_id='0', _timestamp=1777860874390776, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 05/04/2026 02:14:34.391 7f7286cc4380 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-5738-1', _node_type='Control', _instance_id='0', _timestamp=1777860874391374, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-05-04 00:58:13.214043", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-14896-1.novalocal", "build-id": "v0+nightly", "build-number": "202605040008"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 05/04/2026 02:14:34.394 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.395 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-05-04 00:58:13.214043", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-14896-1.novalocal", "build-id": "v0+nightly", "build-number": "202605040008"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> >> 05/04/2026 02:14:34.395 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.395 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.396 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/04/2026 02:14:34.396 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.396 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:34.396 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-05-04 00:58:13.214043", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-14896-1.novalocal", "build-id": "v0+nightly", "build-number": "202605040008"}]} >> 05/04/2026 02:14:34.396 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:38.194 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:38.196 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:38.197 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:41.725 7f7286cc4380 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-5738-1', _node_type='Control', _instance_id='0', _timestamp=1777860881725264, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1777860872000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-05-04 00:58:13.214043", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-14896-1.novalocal", "build-id": "v0+nightly", "build-number": "202605040008"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 05/04/2026 02:14:41.725 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14519756, partition_space_available_1k=66570728, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=38128, cpu_share=0.0, mem_res=8884, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=10540, cpu_share=0.0, mem_res=8380, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11588, cpu_share=0.0, mem_res=9516, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57672, cpu_share=0.0, mem_res=48052, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6529088, free=11705552, buffers=646216, cached=14253020, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.08, five_min_avg=1.74, fifteen_min_avg=1.25, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:14:41.725 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:41.726 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1777860872000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-05-04 00:58:13.214043", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-14896-1.novalocal", "build-id": "v0+nightly", "build-number": "202605040008"}]} >> 05/04/2026 02:14:41.726 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:41.726 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:41.726 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14519756 partition_space_available_1k = 66570728 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 38128 cpu_share = 0.0 mem_res = 8884 >>contrail-dns : << mem_virt = 10540 cpu_share = 0.0 mem_res = 8380 >>contrail-named : << mem_virt = 11588 cpu_share = 0.0 mem_res = 9516 >>contrail-control-nodemgr : << mem_virt = 57672 cpu_share = 0.0 mem_res = 48052 >> } system_mem_usage = << total = 32665120 used = 6529088 free = 11705552 buffers = 646216 cached = 14253020 node_type = control-node >> system_cpu_usage = << one_min_avg = 2.08 five_min_avg = 1.74 fifteen_min_avg = 1.25 cpu_share = 0 node_type = control-node >> >> 05/04/2026 02:14:41.726 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:42.197 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:42.198 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:42.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:46.199 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:46.200 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:46.200 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:46.200 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:46.200 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:46.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:50.201 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:50.202 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:50.202 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:50.202 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:50.202 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:50.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:54.203 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:54.204 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:54.204 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:54.204 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:54.205 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:58.209 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:14:58.210 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:14:58.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:02.211 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:02.212 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:02.212 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:02.212 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:02.212 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:02.213 7f7283b445e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:06.214 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:06.215 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:06.215 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:06.216 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:06.217 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:10.219 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:10.220 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:10.220 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:10.220 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:10.221 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:10.222 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:14.221 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:14.222 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:14.223 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:14.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:14.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:14.224 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:14.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:18.223 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:18.224 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:18.225 7f7283d5ae00 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:22.227 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:22.228 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:22.228 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:22.229 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:26.231 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:26.232 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:26.233 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:30.235 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:30.236 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 05/04/2026 02:15:30.237 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/04/2026 02:15:30.238 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/04/2026 02:15:30.238 7f7283d5ad60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/04/2026 02:15:41.249 7f7283b447c0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 05/04/2026 02:15:41.250 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 05/04/2026 02:15:41.251 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1777860874194113 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 05/04/2026 02:15:41.252 7f7283d5a360 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:41.735 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14951124, partition_space_available_1k=66139360, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39152, cpu_share=0.01, mem_res=9716, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11436, cpu_share=0.01, mem_res=9168, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11932, cpu_share=0.0, mem_res=9612, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57680, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8250652, free=9384524, buffers=658036, cached=14841432, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=1.95, fifteen_min_avg=1.35, cpu_share=3.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:15:41.736 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:41.736 7f72848360e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14951124 partition_space_available_1k = 66139360 percentage_partition_space_used = 18 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 39152 cpu_share = 0.01 mem_res = 9716 >>contrail-dns : << mem_virt = 11436 cpu_share = 0.01 mem_res = 9168 >>contrail-named : << mem_virt = 11932 cpu_share = 0.0 mem_res = 9612 >>contrail-control-nodemgr : << mem_virt = 57680 cpu_share = 0.01 mem_res = 48040 >> } system_mem_usage = << total = 32665120 used = 8250652 free = 9384524 buffers = 658036 cached = 14841432 node_type = control-node >> system_cpu_usage = << one_min_avg = 2.63 five_min_avg = 1.95 fifteen_min_avg = 1.35 cpu_share = 3.25 node_type = control-node >> >> 05/04/2026 02:15:41.736 7f72848360e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/04/2026 02:15:45.255 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5738-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/04/2026 02:15:45.257 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/04/2026 02:15:45.258 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/04/2026 02:15:45.262 7f7283b44d60 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 05/04/2026 02:15:45.262 7f7283b44d60 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/04/2026 02:15:45.262 7f72848360e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/04/2026 02:15:45.263 7f72848360e0 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 05/04/2026 02:15:45.263 7f72848360e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 05/04/2026 02:15:45.263 7f72848360e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/04/2026 02:15:45.263 7f72848360e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/04/2026 02:15:45.264 7f7283d5a5e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/04/2026 02:15:45.264 7f7283d5a5e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/04/2026 02:15:52.918 7f7283b44d60 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 05/04/2026 02:15:52.919 7f7283b44d60 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/04/2026 02:15:52.919 7f7283d5a5e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 05/04/2026 02:15:52.919 7f7283d5a5e0 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 05/04/2026 02:15:52.919 7f7283d5a5e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 05/04/2026 02:15:52.920 7f7283d5a5e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/04/2026 02:16:41.746 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16509152, partition_space_available_1k=64581332, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39432, cpu_share=0.01, mem_res=9968, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11576, cpu_share=0.01, mem_res=9292, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11932, cpu_share=0.0, mem_res=9612, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57692, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9407036, free=17368004, buffers=691860, cached=5668396, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.73, five_min_avg=2.45, fifteen_min_avg=1.56, cpu_share=4.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:17:41.777 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16548620, partition_space_available_1k=64541864, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39236, cpu_share=0.01, mem_res=10112, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11116, cpu_share=0.01, mem_res=9316, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11704, cpu_share=0.0, mem_res=9612, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50108, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9306084, free=20529988, buffers=695004, cached=2604472, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.19, five_min_avg=2.54, fifteen_min_avg=1.66, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:18:41.792 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16552040, partition_space_available_1k=64538444, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39828, cpu_share=0.01, mem_res=10644, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11440, cpu_share=0.01, mem_res=9604, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11760, cpu_share=0.0, mem_res=9616, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50140, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10104816, free=19722956, buffers=695828, cached=2617676, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.33, five_min_avg=2.39, fifteen_min_avg=1.65, cpu_share=2.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:18:47.974 7f7283d5acc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 05/04/2026 02:18:50.417 7f7283d5acc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 05/04/2026 02:19:41.783 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16812156, partition_space_available_1k=64278328, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=40284, cpu_share=0.01, mem_res=11080, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11588, cpu_share=0.01, mem_res=9752, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11760, cpu_share=0.0, mem_res=9616, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53380, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10235128, free=18731944, buffers=711832, cached=3454352, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.37, five_min_avg=2.39, fifteen_min_avg=1.7, cpu_share=3.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:20:41.797 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17060408, partition_space_available_1k=64030076, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43976, cpu_share=0.02, mem_res=13708, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12972, cpu_share=0.02, mem_res=10860, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11760, cpu_share=0.0, mem_res=9616, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53376, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10276688, free=18553592, buffers=721428, cached=3581508, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.16, five_min_avg=3.13, fifteen_min_avg=2.0, cpu_share=4.88, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:21:41.803 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17104692, partition_space_available_1k=63985792, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51120, cpu_share=0.05, mem_res=17572, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15288, cpu_share=0.04, mem_res=12520, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11912, cpu_share=0.0, mem_res=9656, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53384, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10416584, free=18369224, buffers=721524, cached=3625852, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.13, five_min_avg=4.04, fifteen_min_avg=2.38, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:22:41.811 7f7286cc4380 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-5738-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17142636, partition_space_available_1k=63947848, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54796, cpu_share=0.04, mem_res=19420, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17292, cpu_share=0.04, mem_res=13980, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12016, cpu_share=0.0, mem_res=9656, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53392, cpu_share=0.01, mem_res=48040, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10326484, free=18421916, buffers=721560, cached=3663272, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.13, five_min_avg=4.08, fifteen_min_avg=2.5, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 05/04/2026 02:22:57.375 7f728489ba40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map