03/24/2025 00:47:30.857 7f47e753adf0 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/24/2025 00:47:30.857 7f47e753adf0 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/24/2025 00:47:30.857 7f47e753adf0 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/24/2025 00:47:30.865 7f47e57c8148 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 03/24/2025 00:47:30.866 7f47e57c8148 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 03/24/2025 00:47:30.866 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/24/2025 00:47:30.867 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:30.868 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:30.869 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/24/2025 00:47:30.869 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:30.935 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 51207817083509836198726117582207914402632576691663908379385311009890834660041, 'start': '1742777248000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 27869949258856839749430912806914244864853119543428219607235795218563778523941, 'start': '1742777248000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 84372965257249159713667411815690094800030776902634880160136726692376420219530, 'start': '1742777248000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 46890022775448562997743926494064530767961939127927329275065544966461332401963, 'start': '1742777249000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 62874894930234196960392812381707570041634157376286643620712651902592528424286, 'start': '1742777248000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/24/2025 00:47:31.082 7f47e753adf0 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2938-3.', _node_type='Config', _instance_id='0', _timestamp=1742777251082460, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 00:47:31.083 7f47e753adf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2938-3.', _node_type='Config', _instance_id='0', _timestamp=1742777251083156, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777249000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-20 01:11:42.709824", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8222-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 00:47:31.086 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:31.087 7f47e0e89048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-20 01:11:42.709824", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8222-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 03/24/2025 00:47:31.087 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:31.087 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:31.087 7f47e0e89048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:47:31.087 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:31.088 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:31.088 7f47e0e89048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777249000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-20 01:11:42.709824", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8222-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/24/2025 00:47:31.088 7f47e0e89048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:34.867 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:34.869 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:34.869 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:34.869 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:34.869 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:34.869 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:34.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:38.870 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:38.871 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:38.872 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:40.124 7f47e753adf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2938-3.', _node_type='Config', _instance_id='0', _timestamp=1742777260124628, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777249000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742777248000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-20 01:11:42.709824", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8222-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 00:47:40.125 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=5824132, partition_space_available_1k=75266352, percentage_partition_space_used=7, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1592, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=6564, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=63352, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84672, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50516, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=2214592, free=8317156, buffers=199928, cached=5443960, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.93, five_min_avg=0.77, fifteen_min_avg=0.29, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777249000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742777248000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-20 01:11:42.709824", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8222-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 5824132 partition_space_available_1k = 75266352 percentage_partition_space_used = 7 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1592 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 6564 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 63352 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84672 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50516 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175636 used = 2214592 free = 8317156 buffers = 199928 cached = 5443960 node_type = config-node >> system_cpu_usage = << one_min_avg = 1.93 five_min_avg = 0.77 fifteen_min_avg = 0.29 cpu_share = 0 node_type = config-node >> >> 03/24/2025 00:47:40.125 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:42.873 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:42.874 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:42.875 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:42.875 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:42.875 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:42.875 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:42.875 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:42.876 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:46.875 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:46.878 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:46.879 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:50.881 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:50.882 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:50.883 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:50.883 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:50.883 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:50.883 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:50.883 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:50.884 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:54.886 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:54.887 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:54.887 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:54.887 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:54.888 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:58.889 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:47:58.891 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:47:58.891 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:47:58.891 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:47:58.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:02.891 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:02.892 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:02.892 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:02.893 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.895 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:06.897 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:06.897 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:06.898 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.899 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:06.900 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:06.901 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.900 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:10.902 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:10.902 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:10.902 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:10.903 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:10.903 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:10.903 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:10.904 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:10.904 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.904 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:10.904 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:10.905 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:10.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.903 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.905 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:14.906 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:14.906 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.906 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:18.907 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:18.907 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:18.907 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:18.907 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:18.907 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:18.908 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.907 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:22.909 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:22.909 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:22.909 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:22.910 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.913 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:26.915 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:26.915 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:26.915 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:26.915 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:26.915 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:26.916 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.915 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:30.917 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:30.917 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:30.917 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.918 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:30.919 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.919 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:30.919 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:30.919 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.918 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:34.920 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:34.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.921 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:38.922 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:38.923 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:40.111 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6117612, partition_space_available_1k=74972872, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101244, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73504, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69868, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50720, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=2860064, free=7529064, buffers=206556, cached=5579952, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.05, five_min_avg=0.97, fifteen_min_avg=0.39, cpu_share=7.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:48:40.112 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:40.112 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6117612 partition_space_available_1k = 74972872 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 101244 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 73504 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 69868 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84648 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50720 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175636 used = 2860064 free = 7529064 buffers = 206556 cached = 5579952 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.05 five_min_avg = 0.97 fifteen_min_avg = 0.39 cpu_share = 7.25 node_type = config-node >> >> 03/24/2025 00:48:40.112 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.925 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:42.926 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:42.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.928 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:42.928 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.928 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:42.928 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:42.928 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.927 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:46.929 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:46.929 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:46.929 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:46.929 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:46.930 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.931 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:50.932 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:50.932 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:50.933 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:50.934 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.936 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:54.937 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:54.937 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:54.938 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.939 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:48:58.941 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:48:58.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.942 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:02.944 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:02.945 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:02.946 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.947 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:06.949 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:06.949 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:06.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.951 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:06.951 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.951 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:06.951 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:06.951 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.950 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:10.952 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:10.953 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.955 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:14.956 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:14.958 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:14.958 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:14.958 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:14.958 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:14.959 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:14.960 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.958 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:18.960 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:18.960 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:18.960 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:18.960 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:18.960 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.961 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:18.962 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:18.962 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:22.963 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:22.965 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:22.965 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:22.965 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:22.965 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:22.966 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:22.967 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:22.967 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:22.967 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:26.968 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:26.969 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:26.970 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:30.971 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:30.973 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:30.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:30.975 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:30.975 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:34.974 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:34.976 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:34.976 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:34.976 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:34.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:34.978 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:34.978 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:38.977 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:38.978 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:38.978 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:38.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:40.494 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6242672, partition_space_available_1k=74847812, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=102876, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73820, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69928, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50956, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=3022176, free=6905280, buffers=233368, cached=6014812, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.57, five_min_avg=1.01, fifteen_min_avg=0.44, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:49:40.494 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:40.494 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6242672 partition_space_available_1k = 74847812 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 102876 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 73820 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 69928 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84648 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50956 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175636 used = 3022176 free = 6905280 buffers = 233368 cached = 6014812 node_type = config-node >> system_cpu_usage = << one_min_avg = 1.57 five_min_avg = 1.01 fifteen_min_avg = 0.44 cpu_share = 4.25 node_type = config-node >> >> 03/24/2025 00:49:40.494 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:42.979 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:42.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:42.982 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:42.982 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:42.982 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:42.982 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:42.982 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:46.981 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:46.983 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:46.983 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:46.983 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:46.984 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:46.985 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:46.985 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:46.985 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:46.985 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:50.986 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:50.988 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:50.989 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:50.990 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:50.990 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:50.990 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:54.992 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:54.993 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:54.993 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:54.993 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:54.994 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:58.995 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:49:58.997 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:49:58.998 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:49:58.998 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:58.998 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:49:58.998 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:49:58.998 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:49:58.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:02.998 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:02.999 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:02.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:02.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:02.999 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:02.999 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:03.000 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:03.001 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.003 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:07.004 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.005 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:07.006 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.006 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:07.006 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:07.006 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.008 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:11.009 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:11.009 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:11.009 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:11.009 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:11.009 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.010 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:11.011 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:11.011 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.012 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:15.014 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:15.015 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:15.016 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.014 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:19.016 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:19.017 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.018 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:19.018 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.018 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:19.018 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:19.018 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.019 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:23.021 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:23.021 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.022 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:23.023 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:23.023 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.023 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:27.025 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:27.026 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:27.027 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.028 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:31.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:31.031 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.030 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:35.033 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:35.034 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.034 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:39.035 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:39.036 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:40.506 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6632488, partition_space_available_1k=74457996, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=102964, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73888, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69980, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51108, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=4352720, free=5551804, buffers=236948, cached=6034164, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.41, five_min_avg=1.04, fifteen_min_avg=0.49, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:50:40.507 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:40.507 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6632488 partition_space_available_1k = 74457996 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 102964 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 73888 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 69980 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84648 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51108 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175636 used = 4352720 free = 5551804 buffers = 236948 cached = 6034164 node_type = config-node >> system_cpu_usage = << one_min_avg = 1.41 five_min_avg = 1.04 fifteen_min_avg = 0.49 cpu_share = 4.25 node_type = config-node >> >> 03/24/2025 00:50:40.507 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.035 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:43.037 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:43.037 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:43.037 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:43.038 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.041 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:47.043 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:47.043 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:47.044 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:47.045 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.046 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:51.048 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:51.049 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.048 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:55.050 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.051 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:55.052 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.052 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:55.052 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:55.052 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.054 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:50:59.056 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:50:59.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.057 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:03.058 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:03.059 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.061 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:07.063 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:07.063 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:07.063 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:07.063 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:51:07.063 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:07.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.064 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:11.065 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:11.066 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:11.066 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:11.066 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:51:11.066 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:11.066 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:11.067 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:11.068 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.068 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:15.070 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 00:51:15.070 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:15.071 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:15.071 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:51:15.071 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:15.071 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742777250868177 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.57:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 00:51:15.072 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:19.070 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-3. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:51:19.073 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/24/2025 00:51:19.074 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/24/2025 00:51:19.074 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/24/2025 00:51:19.074 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:51:19.074 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:51:27.412 7f47e0e89048 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 03/24/2025 00:51:27.413 7f47e0e89048 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 00:51:27.413 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/24/2025 00:51:27.413 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/24/2025 00:51:27.414 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:51:27.414 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:51:27.414 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/24/2025 00:51:27.414 7f47e1cf3e48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 00:51:27.415 7f47e1cf3e48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 00:51:40.515 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6943784, partition_space_available_1k=74146700, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103032, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73944, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51400, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5034116, free=4440268, buffers=253784, cached=6447468, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.28, five_min_avg=1.3, fifteen_min_avg=0.61, cpu_share=6.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:51:40.880 7f47e0e89048 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001297 03/24/2025 00:51:40.881 7f47e0e89048 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 00:51:40.881 7f47e1cf3648 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/24/2025 00:51:40.881 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 03/24/2025 00:51:40.881 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 00:51:40.881 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:52:40.542 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7080456, partition_space_available_1k=74010028, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103156, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73956, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51640, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5530424, free=3845540, buffers=262244, cached=6537428, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.78, five_min_avg=1.64, fifteen_min_avg=0.77, cpu_share=13.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:53:40.555 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7135160, partition_space_available_1k=73955324, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103920, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73956, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51668, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5527408, free=3799756, buffers=263116, cached=6585356, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.67, five_min_avg=2.08, fifteen_min_avg=0.98, cpu_share=12.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:54:40.565 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7156752, partition_space_available_1k=73933732, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103916, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51700, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5687052, free=3610580, buffers=264644, cached=6613360, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.02, five_min_avg=2.2, fifteen_min_avg=1.09, cpu_share=13.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:55:40.579 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7171544, partition_space_available_1k=73918940, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103960, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51752, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5743928, free=3540784, buffers=266196, cached=6624728, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.16, five_min_avg=2.33, fifteen_min_avg=1.2, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:56:40.581 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7182244, partition_space_available_1k=73908240, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103980, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51752, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5845136, free=3426668, buffers=267524, cached=6636308, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=2.42, fifteen_min_avg=1.3, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:57:40.583 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7174584, partition_space_available_1k=73915900, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103988, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51752, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5882976, free=3390616, buffers=268600, cached=6633444, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.98, five_min_avg=2.8, fifteen_min_avg=1.5, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:58:40.606 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7190364, partition_space_available_1k=73900120, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104072, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51756, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5937752, free=3323868, buffers=269404, cached=6644612, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.82, five_min_avg=2.93, fifteen_min_avg=1.63, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 00:59:40.617 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7201976, partition_space_available_1k=73888508, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104044, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51764, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5974108, free=3273472, buffers=270156, cached=6657900, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.76, five_min_avg=3.37, fifteen_min_avg=1.86, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:00:40.630 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7206964, partition_space_available_1k=73883520, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104040, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51768, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5998736, free=3243828, buffers=270660, cached=6662412, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.93, five_min_avg=3.4, fifteen_min_avg=1.97, cpu_share=11.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:01:40.620 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7211376, partition_space_available_1k=73879108, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104048, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51768, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6018548, free=3217972, buffers=271100, cached=6668016, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.22, five_min_avg=3.29, fifteen_min_avg=2.03, cpu_share=12.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:02:40.646 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7223624, partition_space_available_1k=73866860, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104040, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51768, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5982444, free=3241368, buffers=271464, cached=6680360, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.09, five_min_avg=3.54, fifteen_min_avg=2.19, cpu_share=12.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:03:40.641 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7234248, partition_space_available_1k=73856236, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104332, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51808, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6043552, free=3173348, buffers=271784, cached=6686952, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.89, five_min_avg=3.57, fifteen_min_avg=2.29, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:04:40.648 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7235808, partition_space_available_1k=73854676, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104308, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51812, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6065496, free=3134280, buffers=272016, cached=6703844, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.84, five_min_avg=3.57, fifteen_min_avg=2.36, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:05:40.641 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7246904, partition_space_available_1k=73843580, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104352, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51832, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6120956, free=3076856, buffers=272140, cached=6705684, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.27, five_min_avg=3.71, fifteen_min_avg=2.49, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:06:40.641 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7257840, partition_space_available_1k=73832644, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104456, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51828, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6137536, free=3052956, buffers=272248, cached=6712896, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.74, five_min_avg=3.67, fifteen_min_avg=2.55, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:07:40.652 7f47e753adf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2938-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7263488, partition_space_available_1k=73826996, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104460, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74048, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69992, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84648, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51828, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=6153168, free=3021812, buffers=272336, cached=6728320, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.71, five_min_avg=3.66, fifteen_min_avg=2.62, cpu_share=12.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:08:25.797 7f47e1cf3648 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map