08/21/2025 02:07:06.098 7faad749da48 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/21/2025 02:07:06.098 7faad749da48 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/21/2025 02:07:06.098 7faad749da48 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/21/2025 02:07:06.107 7faad47482e8 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 08/21/2025 02:07:06.107 7faad47482e8 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 08/21/2025 02:07:06.107 7faad474cc18 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 08/21/2025 02:07:06.108 7faad474cc18 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:07:06.108 7faad474cc18 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/21/2025 02:07:06.109 7faad474cc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.242 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 29977318727403048749187286758835545463935758271980918681414938378390559942578, 'start': '1755742024000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 110474399135234108191306687390195216769522800958800136280628587945702892343944, 'start': '1755742024000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 24024016690829868308529653070025290822177836527479729003360094837105310582770, 'start': '1755742024000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 50030417566325968344193687382188146482955815494818487333527627095236297794701, 'start': '1755742024000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 3714387761372890008448125866834942134559205225684617215206193175843426921974, 'start': '1755742024000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 08/21/2025 02:07:06.366 7faad749da48 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3903-1.', _node_type='Config', _instance_id='0', _timestamp=1755742026366587, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/21/2025 02:07:06.367 7faad749da48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3903-1.', _node_type='Config', _instance_id='0', _timestamp=1755742026367150, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-08-21 00:45:10.118740", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10455-1.novalocal", "build-id" : "v0+nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/21/2025 02:07:06.369 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-08-21 00:45:10.118740", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10455-1.novalocal", "build-id" : "v0+nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = v0+nightly-nightly.el7 installed_package_version = v0+nightly-nightly.el7 >> 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:06.371 7faad4a23b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-08-21 00:45:10.118740", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10455-1.novalocal", "build-id" : "v0+nightly", "build-number" : "nightly.el7"}]} >> 08/21/2025 02:07:06.372 7faad4a23b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:10.109 7faad37642e8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:10.110 7faad37642e8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:10.111 7faad37642e8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:14.111 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:14.112 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:14.113 7faad4a51eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:15.410 7faad749da48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3903-1.', _node_type='Config', _instance_id='0', _timestamp=1755742035410418, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1755742024000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-08-21 00:45:10.118740", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10455-1.novalocal", "build-id" : "v0+nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/21/2025 02:07:15.410 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14431364, partition_space_available_1k=66659120, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1624, cpu_share=0.0, mem_res=796, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1584, cpu_share=0.0, mem_res=784, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=172912, cpu_share=0.0, mem_res=170520, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170580, cpu_share=0.0, mem_res=151272, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51956, cpu_share=0.0, mem_res=40156, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=5896652, free=11536256, buffers=676328, cached=14555876, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=1.55, fifteen_min_avg=1.0, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:07:15.410 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:15.411 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1755742024000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-08-21 00:45:10.118740", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10455-1.novalocal", "build-id" : "v0+nightly", "build-number" : "nightly.el7"}]} >> 08/21/2025 02:07:15.411 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:15.411 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:15.411 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14431364 partition_space_available_1k = 66659120 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1624 cpu_share = 0.0 mem_res = 796 >>contrail-schema : << mem_virt = 1584 cpu_share = 0.0 mem_res = 784 >>contrail-svc-monitor : << mem_virt = 172912 cpu_share = 0.0 mem_res = 170520 >>contrail-device-manager : << mem_virt = 170580 cpu_share = 0.0 mem_res = 151272 >>contrail-config-nodemgr : << mem_virt = 51956 cpu_share = 0.0 mem_res = 40156 >> } system_mem_usage = << total = 32665112 used = 5896652 free = 11536256 buffers = 676328 cached = 14555876 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.44 five_min_avg = 1.55 fifteen_min_avg = 1.0 cpu_share = 0 node_type = config-node >> >> 08/21/2025 02:07:15.411 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:18.114 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:18.115 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:18.116 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:18.117 7faad4a23a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:18.117 7faad4a23a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:22.117 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:22.117 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:22.118 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:22.119 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:22.119 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:26.121 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:26.121 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:26.122 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:26.123 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:26.123 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:30.123 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:30.124 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:30.125 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:34.124 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:34.125 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:34.126 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:34.127 7faad4a43c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:34.127 7faad4a43c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:38.127 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:38.128 7faad4748d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:38.129 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:38.130 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:42.133 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:42.134 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:42.135 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:42.135 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:42.135 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:42.135 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:46.134 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:46.135 7faad4748d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:46.135 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:46.135 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:46.135 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:46.136 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:50.138 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:50.139 7faad4748d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:50.139 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:50.139 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:50.140 7faad4748d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:54.140 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:54.141 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:54.142 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:54.142 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:54.142 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:58.142 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:07:58.143 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:07:58.143 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:07:58.143 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:07:58.144 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:02.147 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:02.148 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:02.149 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:02.149 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:02.149 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:02.149 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:06.152 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:06.153 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:06.154 7faad3bf5780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:06.154 7faad3bf5780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:10.154 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:10.155 7faad3c04ac8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:10.155 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:10.155 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:10.156 7faad3c04ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:14.156 7faad6e39630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:14.157 7faad6e39630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:14.158 7faad6e39630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:15.734 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15301644, partition_space_available_1k=65788840, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100952, cpu_share=0.17, mem_res=95500, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82232, cpu_share=0.06, mem_res=77968, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89456, cpu_share=0.04, mem_res=85304, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197088, cpu_share=0.06, mem_res=174396, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52012, cpu_share=0.01, mem_res=40156, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=6247000, free=10228848, buffers=700164, cached=15489100, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.68, five_min_avg=2.08, fifteen_min_avg=1.22, cpu_share=5.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:08:15.734 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:15.734 7faad4a23390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15301644 partition_space_available_1k = 65788840 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 100952 cpu_share = 0.17 mem_res = 95500 >>contrail-schema : << mem_virt = 82232 cpu_share = 0.06 mem_res = 77968 >>contrail-svc-monitor : << mem_virt = 89456 cpu_share = 0.04 mem_res = 85304 >>contrail-device-manager : << mem_virt = 197088 cpu_share = 0.06 mem_res = 174396 >>contrail-config-nodemgr : << mem_virt = 52012 cpu_share = 0.01 mem_res = 40156 >> } system_mem_usage = << total = 32665112 used = 6247000 free = 10228848 buffers = 700164 cached = 15489100 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.68 five_min_avg = 2.08 fifteen_min_avg = 1.22 cpu_share = 5.5 node_type = config-node >> >> 08/21/2025 02:08:15.735 7faad4a23390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:18.158 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:18.159 7faad4a23390 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:18.159 7faad4a23390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:18.159 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:18.160 7faad4a23390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:22.160 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:22.161 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:22.162 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:26.164 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:26.165 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:26.165 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:26.165 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:26.166 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:30.167 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:30.168 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:30.169 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:34.171 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:34.173 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:34.173 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:34.173 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:34.173 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:34.173 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:34.174 7faad4a3bc18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:38.174 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:38.175 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:38.175 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:38.176 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:38.177 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:42.179 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:42.180 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:42.181 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:46.182 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:46.183 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:46.183 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:46.183 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:46.184 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:50.187 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:50.188 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:50.188 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:50.189 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:50.189 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:50.189 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:50.189 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:50.189 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:50.190 7faad4a23eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:54.190 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:54.191 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:54.191 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:54.191 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:54.192 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:58.194 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:08:58.195 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:08:58.195 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:08:58.195 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:08:58.196 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:09:02.198 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:09:02.199 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/21/2025 02:09:02.199 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:09:02.199 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1755742026108742 collector_name = collector_ip = 10.0.0.57:8086 collector_list = [ 10.0.0.57:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/21/2025 02:09:02.200 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/21/2025 02:09:06.202 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/21/2025 02:09:06.203 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3903-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/21/2025 02:09:06.204 7faad4a9f438 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 08/21/2025 02:09:06.205 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/21/2025 02:09:06.205 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/21/2025 02:09:06.205 7faad4a9f438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/21/2025 02:09:12.158 7faad38878d0 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 08/21/2025 02:09:12.158 7faad38878d0 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/21/2025 02:09:12.159 7faad37648d0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/21/2025 02:09:12.159 7faad37648d0 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 08/21/2025 02:09:12.159 7faad37648d0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:09:12.159 7faad37648d0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/21/2025 02:09:12.159 7faad37648d0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/21/2025 02:09:12.160 7faad3764978 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/21/2025 02:09:12.161 7faad3764978 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/21/2025 02:09:15.723 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16173944, partition_space_available_1k=64916540, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101676, cpu_share=0.02, mem_res=96012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82392, cpu_share=0.0, mem_res=78060, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89520, cpu_share=0.0, mem_res=85304, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198476, cpu_share=0.01, mem_res=175636, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52028, cpu_share=0.01, mem_res=40148, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=7976572, free=7515188, buffers=723632, cached=16449720, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.41, five_min_avg=2.59, fifteen_min_avg=1.45, cpu_share=6.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:09:22.101 7faad38878d0 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 08/21/2025 02:09:22.102 7faad38878d0 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/21/2025 02:09:22.102 7faad8699c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/21/2025 02:09:22.102 7faad8699c18 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 08/21/2025 02:09:22.102 7faad8699c18 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:09:22.103 7faad8699c18 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/21/2025 02:10:15.756 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17807860, partition_space_available_1k=63282624, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99608, cpu_share=0.0, mem_res=95964, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80972, cpu_share=0.0, mem_res=78080, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=87800, cpu_share=0.0, mem_res=85304, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179512, cpu_share=0.0, mem_res=175636, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42576, cpu_share=0.01, mem_res=40276, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=8880696, free=20335432, buffers=759504, cached=2689480, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.27, five_min_avg=3.45, fifteen_min_avg=1.82, cpu_share=7.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:11:05.386 7faad3bf5438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:11:07.563 7faad4a9f4e0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:11:15.746 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18199368, partition_space_available_1k=62891116, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99728, cpu_share=0.0, mem_res=96040, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81052, cpu_share=0.0, mem_res=78152, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=87812, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179516, cpu_share=0.0, mem_res=175640, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42668, cpu_share=0.01, mem_res=40332, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9481004, free=19280584, buffers=768412, cached=3135112, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.01, five_min_avg=3.62, fifteen_min_avg=1.98, cpu_share=6.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:12:11.580 7faadd6a8a20 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:12:15.777 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20032596, partition_space_available_1k=61057888, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99760, cpu_share=0.0, mem_res=96060, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81056, cpu_share=0.0, mem_res=78156, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=87840, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179600, cpu_share=0.0, mem_res=175640, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42756, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=9761408, free=16987812, buffers=821856, cached=5094036, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.68, five_min_avg=3.8, fifteen_min_avg=2.15, cpu_share=7.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:13:15.781 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20098132, partition_space_available_1k=60992352, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=117600, cpu_share=0.11, mem_res=98652, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81444, cpu_share=0.01, mem_res=78324, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88060, cpu_share=0.01, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179824, cpu_share=0.0, mem_res=175640, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42760, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10110252, free=16526584, buffers=822644, cached=5205632, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.16, five_min_avg=4.32, fifteen_min_avg=2.43, cpu_share=7.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:14:15.786 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20216968, partition_space_available_1k=60873516, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=121680, cpu_share=0.11, mem_res=100856, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81872, cpu_share=0.01, mem_res=78508, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88484, cpu_share=0.01, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180240, cpu_share=0.01, mem_res=175656, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42756, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10868136, free=15647284, buffers=822712, cached=5326980, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.15, five_min_avg=5.01, fifteen_min_avg=2.79, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:15:15.790 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20247200, partition_space_available_1k=60843284, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123960, cpu_share=0.11, mem_res=101024, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82832, cpu_share=0.02, mem_res=78792, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89156, cpu_share=0.02, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181116, cpu_share=0.01, mem_res=175856, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42760, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10302368, free=16171604, buffers=823068, cached=5368072, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.27, five_min_avg=5.24, fifteen_min_avg=3.02, cpu_share=7.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:16:15.798 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20280888, partition_space_available_1k=60809596, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128600, cpu_share=0.08, mem_res=104052, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83356, cpu_share=0.01, mem_res=78912, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89536, cpu_share=0.01, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181532, cpu_share=0.01, mem_res=175896, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42756, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10380860, free=16060008, buffers=823136, cached=5401108, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.08, five_min_avg=5.42, fifteen_min_avg=3.23, cpu_share=7.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:17:15.806 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20370172, partition_space_available_1k=60720312, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=131236, cpu_share=0.06, mem_res=105612, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83640, cpu_share=0.01, mem_res=78980, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89720, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181772, cpu_share=0.0, mem_res=175940, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42764, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11458492, free=14925132, buffers=823368, cached=5458120, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.11, five_min_avg=5.57, fifteen_min_avg=3.42, cpu_share=7.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:18:15.821 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20371996, partition_space_available_1k=60718488, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=132564, cpu_share=0.07, mem_res=105656, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84148, cpu_share=0.01, mem_res=79176, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89996, cpu_share=0.01, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182056, cpu_share=0.01, mem_res=175968, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42768, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=11055412, free=15297952, buffers=823440, cached=5488308, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.17, five_min_avg=5.41, fifteen_min_avg=3.5, cpu_share=6.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:19:15.812 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20397448, partition_space_available_1k=60693036, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=133796, cpu_share=0.05, mem_res=105928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84416, cpu_share=0.01, mem_res=79176, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90268, cpu_share=0.01, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182324, cpu_share=0.01, mem_res=175968, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42768, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10639100, free=15682640, buffers=823484, cached=5519888, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.97, five_min_avg=5.31, fifteen_min_avg=3.59, cpu_share=7.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:20:15.822 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20507572, partition_space_available_1k=60582912, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=134588, cpu_share=0.05, mem_res=105928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84564, cpu_share=0.0, mem_res=79176, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90396, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182492, cpu_share=0.0, mem_res=175968, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42768, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10433052, free=15773320, buffers=823600, cached=5635140, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.17, five_min_avg=5.33, fifteen_min_avg=3.71, cpu_share=7.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:21:15.824 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20527956, partition_space_available_1k=60562528, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=135252, cpu_share=0.04, mem_res=105968, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84720, cpu_share=0.0, mem_res=79176, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90548, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182628, cpu_share=0.0, mem_res=175972, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42772, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10458620, free=15733264, buffers=823628, cached=5649600, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.78, five_min_avg=5.29, fifteen_min_avg=3.8, cpu_share=6.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:22:12.696 7faad4a51d68 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/21/2025 02:22:15.832 7faad749da48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3903-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=20537580, partition_space_available_1k=60552904, percentage_partition_space_used=25, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=136416, cpu_share=0.04, mem_res=106356, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84900, cpu_share=0.0, mem_res=79176, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90744, cpu_share=0.0, mem_res=85308, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182872, cpu_share=0.0, mem_res=175996, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42776, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665112, used=10494236, free=15685212, buffers=823648, cached=5662016, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.0, five_min_avg=5.54, fifteen_min_avg=3.98, cpu_share=6.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/21/2025 02:22:50.049 7faad4a4e630 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map