03/27/2025 00:49:10.060 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/27/2025 00:49:10.060 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/27/2025 00:49:10.060 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/27/2025 00:49:10.069 7fcc6e99b548 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 03/27/2025 00:49:10.069 7fcc6e99b548 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 03/27/2025 00:49:10.070 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/27/2025 00:49:10.071 7fcc6e99bd48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:49:10.074 7fcc6e99bd48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:49:10.075 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/27/2025 00:49:10.075 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.075 7fcc6e99bd48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:49:10.075 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.075 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.076 7fcc6e99bd48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/27/2025 00:49:10.076 7fcc6e99bd48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.352 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 85742784279617188907860471953553857894091857792838258338880100223984368852680, 'start': '1743036547000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 94892388850731517793048190081768310585372041618819974367117957593858833842078, 'start': '1743036547000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 42311178439767490955315707337783955055030870288844092483804200074835649798091, 'start': '1743036547000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 104336270495524448816657563183350423221396913967802969361977648311164570679015, 'start': '1743036547000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/27/2025 00:49:10.609 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2962-1', _node_type='Control', _instance_id='0', _timestamp=1743036550609492, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/27/2025 00:49:10.610 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2962-1', _node_type='Control', _instance_id='0', _timestamp=1743036550610164, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-24 01:17:35.868579", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8260-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/27/2025 00:49:10.612 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-24 01:17:35.868579", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8260-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.613 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.614 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-24 01:17:35.868579", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8260-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/27/2025 00:49:10.614 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.072 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:14.074 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:14.075 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:14.075 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:14.075 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:14.075 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:14.075 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:14.076 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:14.076 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.076 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:14.076 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.076 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.077 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:14.077 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.076 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:18.077 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:18.077 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:18.077 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:18.077 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.078 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.079 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:18.079 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.093 7fcc740b3df0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2962-1', _node_type='Control', _instance_id='0', _timestamp=1743036558093069, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743036547000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-24 01:17:35.868579", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8260-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/27/2025 00:49:18.093 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13324416, partition_space_available_1k=67766068, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19368, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18312, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51068, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6201484, free=267420, buffers=639136, cached=9067592, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.79, five_min_avg=4.29, fifteen_min_avg=2.39, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:49:18.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.093 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743036547000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-24 01:17:35.868579", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8260-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/27/2025 00:49:18.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.094 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13324416 partition_space_available_1k = 67766068 percentage_partition_space_used = 16 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 19368 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 18312 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21772 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 51068 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175632 used = 6201484 free = 267420 buffers = 639136 cached = 9067592 node_type = control-node >> system_cpu_usage = << one_min_avg = 6.79 five_min_avg = 4.29 fifteen_min_avg = 2.39 cpu_share = 0 node_type = control-node >> >> 03/27/2025 00:49:18.094 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.081 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:22.082 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:22.082 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:22.082 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:22.082 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:22.084 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:22.084 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:22.084 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:22.084 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.084 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:22.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.085 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:22.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.083 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:26.085 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:26.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:26.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:26.086 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.085 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:30.087 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:30.088 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.089 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:34.092 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:34.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.093 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:38.095 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:38.096 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:38.096 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:38.096 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:38.096 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:38.096 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:38.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.096 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:42.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:42.098 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.099 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:46.100 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:46.100 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:46.100 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.101 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:46.102 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.103 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:50.104 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:50.105 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:50.106 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.108 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:54.109 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:54.110 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.109 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:58.111 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:58.111 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:58.111 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:58.111 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:49:58.112 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.115 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.117 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:02.118 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.118 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.118 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:02.118 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.117 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:06.120 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:06.121 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.122 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.122 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:06.122 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.124 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:10.126 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:10.126 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:10.126 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:10.126 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.127 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.128 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:10.128 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.134 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:14.137 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:14.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.097 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13707484, partition_space_available_1k=67383000, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20320, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19004, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50580, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=7493920, free=275752, buffers=656548, cached=7749412, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.64, five_min_avg=4.34, fifteen_min_avg=2.52, cpu_share=18.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:50:18.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.097 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13707484 partition_space_available_1k = 67383000 percentage_partition_space_used = 17 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 20320 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 19004 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21772 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50580 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175632 used = 7493920 free = 275752 buffers = 656548 cached = 7749412 node_type = control-node >> system_cpu_usage = << one_min_avg = 5.64 five_min_avg = 4.34 fifteen_min_avg = 2.52 cpu_share = 18.0 node_type = control-node >> >> 03/27/2025 00:50:18.097 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.137 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:18.138 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:18.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:18.138 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:18.139 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:18.139 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:18.139 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:18.139 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:18.140 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.140 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:18.140 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.140 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.140 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:18.141 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.142 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:22.143 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:22.143 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:22.143 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:22.143 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:22.144 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.146 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:26.148 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.150 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:26.150 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.149 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:30.151 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:30.152 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.153 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:34.155 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:34.155 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:34.155 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:34.155 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:34.155 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:34.156 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.158 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:38.160 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:38.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.161 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:42.162 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:42.162 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:42.163 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.164 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:42.164 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.164 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.164 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:42.164 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.165 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:46.167 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:46.167 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:46.168 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.169 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:46.169 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.169 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.169 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:46.169 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.169 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:50.171 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:50.172 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.174 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:54.175 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:54.176 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.175 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:58.177 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:58.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.179 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:58.179 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.179 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.179 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:50:58.179 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.178 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:02.179 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:51:02.180 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.181 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.181 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:51:02.181 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:06.183 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:06.184 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/27/2025 00:51:06.185 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/27/2025 00:51:06.185 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/27/2025 00:51:06.185 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:06.185 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:18.124 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13728416, partition_space_available_1k=67362068, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20712, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19316, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50680, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=7804816, free=266908, buffers=659964, cached=7443944, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.81, five_min_avg=4.64, fifteen_min_avg=2.74, cpu_share=19.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:51:18.125 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:20.301 7fcc6e8f9248 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:20.302 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:20.303 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1743036550074797 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.36:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/27/2025 00:51:20.303 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:24.305 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:24.307 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/27/2025 00:51:24.307 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:24.307 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/27/2025 00:51:24.308 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:24.309 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:24.314 7fcc6e8f9248 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 03/27/2025 00:51:24.315 7fcc6e8f9248 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/27/2025 00:51:24.315 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/27/2025 00:51:24.315 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/27/2025 00:51:24.316 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:51:24.316 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:51:24.316 7fcc6da06248 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/27/2025 00:51:24.316 7fcc6e99be48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/27/2025 00:51:24.318 7fcc6e99be48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/27/2025 00:51:32.250 7fcc6e8f9248 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 03/27/2025 00:51:32.250 7fcc6e8f9248 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/27/2025 00:51:32.250 7fcc6e99be48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/27/2025 00:51:32.251 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 03/27/2025 00:51:32.251 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:51:32.251 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:52:18.198 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14149224, partition_space_available_1k=66941260, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19472, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50740, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8746764, free=275100, buffers=670700, cached=6483068, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.43, five_min_avg=5.96, fifteen_min_avg=3.32, cpu_share=20.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:53:18.153 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14205504, partition_space_available_1k=66884980, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20904, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19748, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50792, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8604616, free=375928, buffers=671044, cached=6524044, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.3, five_min_avg=5.71, fifteen_min_avg=3.4, cpu_share=16.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:54:18.153 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14464020, partition_space_available_1k=66626464, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21144, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19936, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8581940, free=293928, buffers=675128, cached=6624636, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.02, five_min_avg=5.65, fifteen_min_avg=3.52, cpu_share=14.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:54:20.620 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:54:56.235 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:55:16.955 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:55:18.156 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14698688, partition_space_available_1k=66391796, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21172, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20000, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50948, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8643004, free=363476, buffers=676184, cached=6492968, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.94, five_min_avg=5.71, fifteen_min_avg=3.68, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:55:37.301 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:55:56.820 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:56:18.147 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14711280, partition_space_available_1k=66379204, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21332, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20048, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50952, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8680532, free=316784, buffers=676360, cached=6501956, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.93, five_min_avg=5.47, fifteen_min_avg=3.72, cpu_share=14.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:56:18.551 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:56:38.416 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:56:57.857 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:57:18.146 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14706884, partition_space_available_1k=66383600, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21324, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20052, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50980, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8661472, free=341452, buffers=676640, cached=6496068, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.89, five_min_avg=5.1, fifteen_min_avg=3.71, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:57:19.216 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:57:38.591 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:57:58.739 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:58:18.148 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14720176, partition_space_available_1k=66370308, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21480, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20120, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51012, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8773108, free=289868, buffers=676192, cached=6436464, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.66, five_min_avg=4.76, fifteen_min_avg=3.67, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:58:20.716 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:58:41.126 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:59:00.919 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:59:18.151 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14729996, partition_space_available_1k=66360488, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21512, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20120, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51016, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8694720, free=383896, buffers=677104, cached=6419912, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.75, five_min_avg=4.6, fifteen_min_avg=3.69, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 00:59:22.464 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 00:59:42.599 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:00:18.171 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14738088, partition_space_available_1k=66352396, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21480, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51028, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8776776, free=324536, buffers=676208, cached=6398112, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.33, five_min_avg=4.32, fifteen_min_avg=3.65, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:00:54.281 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:01:15.171 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:01:18.151 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14748848, partition_space_available_1k=66341636, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21504, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51060, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8806088, free=356712, buffers=676548, cached=6336284, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.52, five_min_avg=4.21, fifteen_min_avg=3.65, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:01:36.638 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:01:56.588 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:02:17.418 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:02:18.207 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14756952, partition_space_available_1k=66333532, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21432, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51068, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8813880, free=407748, buffers=676460, cached=6277544, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.75, five_min_avg=4.43, fifteen_min_avg=3.76, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:02:37.946 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:02:57.935 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:03:18.177 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14764484, partition_space_available_1k=66326000, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21584, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20216, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51076, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8882352, free=340656, buffers=676260, cached=6276364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.11, five_min_avg=4.27, fifteen_min_avg=3.75, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:03:18.852 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:03:39.669 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:03:59.951 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:04:18.178 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14774688, partition_space_available_1k=66315796, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21600, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20228, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51072, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8830712, free=392504, buffers=676536, cached=6275880, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.96, five_min_avg=4.72, fifteen_min_avg=3.93, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:04:20.427 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:04:40.774 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:05:01.251 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:05:18.174 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14779224, partition_space_available_1k=66311260, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21616, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20268, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51080, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8943180, free=306156, buffers=676484, cached=6249812, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.26, five_min_avg=4.42, fifteen_min_avg=3.87, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:05:22.217 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:05:43.410 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:06:03.841 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:06:18.190 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14788284, partition_space_available_1k=66302200, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21624, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20272, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51100, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8857796, free=377692, buffers=676796, cached=6263348, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.43, five_min_avg=4.18, fifteen_min_avg=3.83, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:06:24.172 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:06:44.929 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:07:05.799 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:07:18.215 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14805876, partition_space_available_1k=66284608, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21612, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20272, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51120, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8870852, free=376016, buffers=676808, cached=6251956, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.32, five_min_avg=3.98, fifteen_min_avg=3.78, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:07:26.434 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:07:46.927 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:08:07.332 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:08:18.199 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14812680, partition_space_available_1k=66277804, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21616, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20272, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51124, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8938112, free=344652, buffers=676660, cached=6216208, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.62, five_min_avg=3.92, fifteen_min_avg=3.77, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:08:28.147 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:08:48.669 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:09:08.893 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:09:18.213 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14814884, partition_space_available_1k=66275600, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21684, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20272, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51120, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8930188, free=382720, buffers=676800, cached=6185924, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.14, five_min_avg=3.71, fifteen_min_avg=3.7, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:09:29.555 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:09:50.294 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:10:10.591 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:10:18.215 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14825308, partition_space_available_1k=66265176, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21624, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51136, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8932012, free=380804, buffers=676836, cached=6185980, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.9, five_min_avg=3.82, fifteen_min_avg=3.74, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:10:31.403 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:10:52.142 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:11:12.868 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:11:18.226 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14807620, partition_space_available_1k=66282864, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21536, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51144, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8951400, free=379508, buffers=676792, cached=6167932, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.43, five_min_avg=3.95, fifteen_min_avg=3.79, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:11:33.790 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:11:53.844 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:12:14.568 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:12:18.250 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14819484, partition_space_available_1k=66271000, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21528, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51164, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=9069492, free=293388, buffers=676756, cached=6135996, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.62, five_min_avg=4.02, fifteen_min_avg=3.82, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:12:35.710 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:12:55.804 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:13:16.693 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:13:18.253 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14822004, partition_space_available_1k=66268480, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21620, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51172, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=9040800, free=364120, buffers=676656, cached=6094056, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.97, five_min_avg=3.89, fifteen_min_avg=3.79, cpu_share=14.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:13:37.228 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:13:57.291 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:14:17.822 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:14:18.236 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14831296, partition_space_available_1k=66259188, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21588, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51168, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=8994260, free=415576, buffers=676616, cached=6089180, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.65, five_min_avg=4.1, fifteen_min_avg=3.86, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:14:38.230 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:14:48.010 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:14:57.479 7fcc6e99be48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/27/2025 01:15:18.244 7fcc740b3df0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2962-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14836760, partition_space_available_1k=66253724, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21656, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20280, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21772, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51176, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=9035540, free=367564, buffers=676636, cached=6095892, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.07, five_min_avg=4.23, fifteen_min_avg=3.92, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/27/2025 01:16:00.560 7fcc6da06248 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map