03/20/2025 00:47:37.692 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 00:47:37.692 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 00:47:37.692 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 00:47:37.698 7f85d4fcd148 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 03/20/2025 00:47:37.699 7f85d4fcd148 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 03/20/2025 00:47:37.699 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 00:47:37.700 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 00:47:37.700 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:47:37.700 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 00:47:37.700 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.701 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:47:37.701 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.701 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.701 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 00:47:37.701 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.768 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 100495392398258279483631133929605425412755585540200834849547261743112824736813, 'start': '1742431656000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 7124078737585030973113829437109823643995902238130649495792814851826016723623, 'start': '1742431656000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 100536229914135557039390863118733383562571107457811142242632743435169079607332, 'start': '1742431656000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 44206349440039176877191457947539869765475461721221271147911398195871188796644, 'start': '1742431655000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/20/2025 00:47:37.897 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742431657897801, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 00:47:37.898 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742431657898334, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431655000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 00:47:37.900 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.901 7f85d14f6348 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 03/20/2025 00:47:37.901 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431655000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/20/2025 00:47:37.902 7f85d14f6348 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:41.700 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:41.702 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:41.702 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:41.702 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:41.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:44.926 7f85d6d3edf0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742431664926446, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431656000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742431655000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 00:47:44.926 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6287956, partition_space_available_1k=74802528, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18792, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18108, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50672, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=3103492, free=6921884, buffers=214144, cached=5936108, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.51, five_min_avg=0.8, fifteen_min_avg=0.4, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431656000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742431655000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6287956 partition_space_available_1k = 74802528 percentage_partition_space_used = 8 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 18792 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 18108 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 24116 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50672 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175628 used = 3103492 free = 6921884 buffers = 214144 cached = 5936108 node_type = control-node >> system_cpu_usage = << one_min_avg = 0.51 five_min_avg = 0.8 fifteen_min_avg = 0.4 cpu_share = 0 node_type = control-node >> >> 03/20/2025 00:47:44.927 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:45.703 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:45.705 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:45.706 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:45.706 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:45.706 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:45.706 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:49.707 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:49.708 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:49.709 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:53.708 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:53.710 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:53.711 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:57.713 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:57.715 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:57.715 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:57.715 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:57.716 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:57.717 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:57.717 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:57.717 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:47:57.717 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:01.719 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:01.720 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:01.721 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:05.723 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:05.725 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:05.725 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:05.725 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:05.725 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:05.725 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:05.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:09.726 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:09.728 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:09.729 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:13.732 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:13.734 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:13.735 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:17.738 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:17.740 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:17.740 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:17.741 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:17.741 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:17.741 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:17.741 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:17.742 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:21.743 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:21.744 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:21.745 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:21.746 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:25.747 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:25.748 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:25.749 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:29.751 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:29.753 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:29.754 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:33.755 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:33.756 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:33.756 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:33.756 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:33.756 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:33.757 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.759 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:37.760 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:37.760 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:37.760 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:37.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:41.761 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:41.763 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:41.764 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:44.934 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6677880, partition_space_available_1k=74412604, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20320, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18716, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50988, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=4377836, free=5427148, buffers=237524, cached=6133120, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.59, five_min_avg=0.98, fifteen_min_avg=0.48, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:48:44.935 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:44.935 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6677880 partition_space_available_1k = 74412604 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 20320 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 18716 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 24116 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50988 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175628 used = 4377836 free = 5427148 buffers = 237524 cached = 6133120 node_type = control-node >> system_cpu_usage = << one_min_avg = 1.59 five_min_avg = 0.98 fifteen_min_avg = 0.48 cpu_share = 4.5 node_type = control-node >> >> 03/20/2025 00:48:44.935 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:45.763 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:45.765 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:45.766 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:45.766 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:45.766 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:45.766 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:45.766 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:45.767 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:45.767 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:45.767 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:45.767 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:45.767 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:45.768 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:45.768 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:49.767 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:49.768 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:49.768 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:49.768 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:49.768 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:49.768 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:49.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:53.769 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:53.771 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:53.771 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:53.771 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:53.771 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:53.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:57.772 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:57.774 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:48:57.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:01.775 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:01.776 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:01.777 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:05.779 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:05.781 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:05.782 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:09.781 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:09.783 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:09.784 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:13.786 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:13.787 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:13.787 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:13.787 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:13.788 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:17.791 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:17.792 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:17.792 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:17.792 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:17.793 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:21.795 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:21.796 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:21.796 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:21.796 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:21.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:25.797 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:25.798 7f85d1782648 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:25.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:25.802 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742431657700617 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 00:49:25.802 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:29.801 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:29.803 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 00:49:29.804 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 00:49:29.804 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 00:49:29.805 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:29.805 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:40.068 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 03/20/2025 00:49:40.069 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:40.070 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 00:49:40.070 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 00:49:40.070 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 00:49:40.070 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:49:40.070 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 00:49:40.071 7f85d1782e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:40.071 7f85d1782e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:44.943 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7061348, partition_space_available_1k=74029136, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21096, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18896, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51224, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=4642876, free=4816084, buffers=250976, cached=6465692, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.46, five_min_avg=1.0, fifteen_min_avg=0.52, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:49:50.814 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 03/20/2025 00:49:50.815 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:50.815 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 00:49:50.816 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 03/20/2025 00:49:50.816 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 00:49:50.816 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:50:44.961 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7124224, partition_space_available_1k=73966260, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21096, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19048, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51516, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5618000, free=3662404, buffers=261688, cached=6633536, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.47, five_min_avg=1.38, fifteen_min_avg=0.68, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:51:44.979 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7183224, partition_space_available_1k=73907260, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19100, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51536, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5621136, free=3607280, buffers=262656, cached=6684556, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.52, five_min_avg=1.56, fifteen_min_avg=0.79, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:52:16.162 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 00:52:44.989 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7650420, partition_space_available_1k=73440064, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21748, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19372, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51596, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5660776, free=3064612, buffers=269216, cached=7181024, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.79, five_min_avg=1.79, fifteen_min_avg=0.92, cpu_share=12.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:52:59.148 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 00:53:44.991 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7663540, partition_space_available_1k=73426944, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19464, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51648, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5703756, free=3010576, buffers=270960, cached=7190336, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.53, five_min_avg=1.88, fifteen_min_avg=1.0, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:54:44.997 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7672040, partition_space_available_1k=73418444, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22216, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19496, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51656, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5773780, free=2929784, buffers=272716, cached=7199348, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.75, five_min_avg=2.33, fifteen_min_avg=1.21, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:55:45.008 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7676420, partition_space_available_1k=73414064, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22220, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51656, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5826216, free=2880812, buffers=273876, cached=7194724, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.36, five_min_avg=2.49, fifteen_min_avg=1.34, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:56:45.021 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7684720, partition_space_available_1k=73405764, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22260, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19648, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51676, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5864432, free=2818516, buffers=275032, cached=7217648, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.48, five_min_avg=2.35, fifteen_min_avg=1.36, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:57:45.039 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7693308, partition_space_available_1k=73397176, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22384, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19700, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51704, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5881968, free=2795368, buffers=275624, cached=7222668, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.02, five_min_avg=2.54, fifteen_min_avg=1.49, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:58:45.041 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7703376, partition_space_available_1k=73387108, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22380, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19724, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51704, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5903260, free=2762688, buffers=276080, cached=7233600, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.83, five_min_avg=2.29, fifteen_min_avg=1.47, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 00:59:45.042 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7718816, partition_space_available_1k=73371668, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22444, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19740, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51708, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5957768, free=2701468, buffers=276388, cached=7240004, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.6, five_min_avg=2.6, fifteen_min_avg=1.62, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:00:45.063 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7719240, partition_space_available_1k=73371244, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22540, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19748, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51708, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5990200, free=2653784, buffers=276600, cached=7255044, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.95, five_min_avg=2.59, fifteen_min_avg=1.68, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:01:45.069 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7728684, partition_space_available_1k=73361800, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22644, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19756, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51712, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6025976, free=2613112, buffers=276840, cached=7259700, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.09, five_min_avg=2.72, fifteen_min_avg=1.79, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:02:45.089 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7738044, partition_space_available_1k=73352440, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22632, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19760, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51752, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6075392, free=2548472, buffers=276956, cached=7274808, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.53, five_min_avg=2.61, fifteen_min_avg=1.81, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:03:45.075 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7747280, partition_space_available_1k=73343204, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22724, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19760, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51736, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6094148, free=2524596, buffers=277068, cached=7279816, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.68, five_min_avg=2.62, fifteen_min_avg=1.87, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:04:45.077 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7756708, partition_space_available_1k=73333776, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22668, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19760, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51736, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6156400, free=2447536, buffers=277108, cached=7294584, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.64, five_min_avg=2.61, fifteen_min_avg=1.91, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:05:45.086 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7765740, partition_space_available_1k=73324744, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22648, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19760, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51736, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6181452, free=2412660, buffers=277144, cached=7304372, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.81, five_min_avg=2.65, fifteen_min_avg=1.97, cpu_share=11.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:06:45.112 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7778492, partition_space_available_1k=73311992, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22736, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19764, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51756, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6200556, free=2390252, buffers=277164, cached=7307656, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.33, five_min_avg=2.56, fifteen_min_avg=1.98, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:07:45.096 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7784692, partition_space_available_1k=73305792, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22748, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19764, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51756, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6176960, free=2402868, buffers=277176, cached=7318624, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.29, five_min_avg=2.5, fifteen_min_avg=2.0, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:08:45.088 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7788304, partition_space_available_1k=73302180, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19792, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51760, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6202484, free=2373100, buffers=277196, cached=7322848, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=2.51, fifteen_min_avg=2.04, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:09:45.093 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7799996, partition_space_available_1k=73290488, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22936, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19792, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51760, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6215240, free=2358112, buffers=277228, cached=7325048, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.88, five_min_avg=2.58, fifteen_min_avg=2.09, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:10:45.103 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7785760, partition_space_available_1k=73304724, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19792, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51760, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6224448, free=2353252, buffers=277228, cached=7320700, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.4, five_min_avg=2.52, fifteen_min_avg=2.1, cpu_share=11.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:11:45.096 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7794156, partition_space_available_1k=73296328, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22740, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19800, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6244104, free=2330544, buffers=277248, cached=7323732, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.64, five_min_avg=2.84, fifteen_min_avg=2.23, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:12:45.112 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7798844, partition_space_available_1k=73291640, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22676, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19804, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6243196, free=2320876, buffers=277260, cached=7334296, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.45, five_min_avg=2.63, fifteen_min_avg=2.2, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:13:45.106 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7802660, partition_space_available_1k=73287824, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22916, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19804, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51788, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6226284, free=2328684, buffers=277264, cached=7343396, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.45, five_min_avg=2.6, fifteen_min_avg=2.21, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:14:45.100 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7813888, partition_space_available_1k=73276596, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19804, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51792, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6258548, free=2290052, buffers=277280, cached=7349748, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=2.62, fifteen_min_avg=2.24, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:15:45.102 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7818264, partition_space_available_1k=73272220, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22924, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51796, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6256972, free=2286808, buffers=277284, cached=7354564, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.62, five_min_avg=2.61, fifteen_min_avg=2.26, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:16:45.109 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7823428, partition_space_available_1k=73267056, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22964, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51804, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6263452, free=2276060, buffers=277288, cached=7358828, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.88, five_min_avg=2.66, fifteen_min_avg=2.3, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:17:45.125 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7831544, partition_space_available_1k=73258940, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22756, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51844, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6272092, free=2258348, buffers=277304, cached=7367884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.39, five_min_avg=2.55, fifteen_min_avg=2.29, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:18:45.124 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7840592, partition_space_available_1k=73249892, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22716, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51844, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6285896, free=2240712, buffers=277308, cached=7371712, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=2.43, fifteen_min_avg=2.26, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:19:45.141 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7847324, partition_space_available_1k=73243160, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22792, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6287532, free=2231784, buffers=277312, cached=7379000, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.45, five_min_avg=2.45, fifteen_min_avg=2.28, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:20:45.143 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7850384, partition_space_available_1k=73240100, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22856, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6276196, free=2230020, buffers=277316, cached=7392096, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.4, five_min_avg=2.73, fifteen_min_avg=2.38, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:21:45.157 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7854452, partition_space_available_1k=73236032, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22948, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19812, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51864, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6283256, free=2219036, buffers=277324, cached=7396012, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.9, five_min_avg=2.67, fifteen_min_avg=2.38, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:22:45.180 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7863944, partition_space_available_1k=73226540, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22980, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6287744, free=2209476, buffers=277324, cached=7401084, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.1, five_min_avg=2.75, fifteen_min_avg=2.42, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:23:45.182 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7868344, partition_space_available_1k=73222140, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23008, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6286416, free=2206108, buffers=277324, cached=7405780, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.79, five_min_avg=2.73, fifteen_min_avg=2.44, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:24:45.181 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7878608, partition_space_available_1k=73211876, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23168, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6302508, free=2184468, buffers=277324, cached=7411328, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.87, five_min_avg=2.98, fifteen_min_avg=2.54, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:25:45.198 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7884060, partition_space_available_1k=73206424, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23100, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6302684, free=2178484, buffers=277328, cached=7417132, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.65, five_min_avg=2.78, fifteen_min_avg=2.5, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:26:45.195 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7889704, partition_space_available_1k=73200780, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6310252, free=2165384, buffers=277328, cached=7422664, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.56, five_min_avg=2.73, fifteen_min_avg=2.5, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:27:45.235 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7895548, partition_space_available_1k=73194936, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23196, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6308960, free=2160596, buffers=277328, cached=7428744, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.37, five_min_avg=2.64, fifteen_min_avg=2.48, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:28:45.224 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7900188, partition_space_available_1k=73190296, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23040, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6307036, free=2152768, buffers=277332, cached=7438492, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.27, five_min_avg=2.56, fifteen_min_avg=2.46, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:29:45.219 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7918120, partition_space_available_1k=73172364, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23072, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6282876, free=2153744, buffers=277336, cached=7461672, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.27, five_min_avg=2.49, fifteen_min_avg=2.44, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:30:45.230 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7928584, partition_space_available_1k=73161900, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23064, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19816, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6285888, free=2144360, buffers=277340, cached=7468040, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.57, five_min_avg=2.52, fifteen_min_avg=2.46, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:31:45.223 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7934844, partition_space_available_1k=73155640, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23044, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6265368, free=2158784, buffers=277340, cached=7474136, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.56, five_min_avg=2.53, fifteen_min_avg=2.46, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:32:45.259 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7944864, partition_space_available_1k=73145620, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23116, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6295816, free=2123092, buffers=277340, cached=7479380, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.54, five_min_avg=2.53, fifteen_min_avg=2.46, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:33:45.253 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7950456, partition_space_available_1k=73140028, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22960, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6298996, free=2114024, buffers=277344, cached=7485264, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.85, five_min_avg=2.34, fifteen_min_avg=2.4, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:34:45.247 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7955040, partition_space_available_1k=73135444, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6300540, free=2108004, buffers=277348, cached=7489736, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=2.32, fifteen_min_avg=2.39, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:35:45.259 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7959184, partition_space_available_1k=73131300, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51892, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6308680, free=2095224, buffers=277348, cached=7494376, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.18, five_min_avg=2.33, fifteen_min_avg=2.39, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:36:45.273 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7964432, partition_space_available_1k=73126052, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51892, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6311048, free=2082488, buffers=277348, cached=7504744, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.47, five_min_avg=2.39, fifteen_min_avg=2.41, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:37:45.270 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7977116, partition_space_available_1k=73113368, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22964, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51892, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6319464, free=2066008, buffers=277352, cached=7512804, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.01, five_min_avg=2.31, fifteen_min_avg=2.38, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:38:45.258 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7981536, partition_space_available_1k=73108948, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23020, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6309664, free=2070836, buffers=277352, cached=7517776, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.66, five_min_avg=2.42, fifteen_min_avg=2.41, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:39:45.256 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7987448, partition_space_available_1k=73103036, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22952, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6340736, free=2034124, buffers=277352, cached=7523416, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=2.41, fifteen_min_avg=2.41, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:40:45.258 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7992640, partition_space_available_1k=73097844, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22980, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6327172, free=2037748, buffers=277352, cached=7533356, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.66, five_min_avg=2.46, fifteen_min_avg=2.42, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:41:45.256 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7997712, partition_space_available_1k=73092772, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23088, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6327476, free=2032136, buffers=277352, cached=7538664, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.33, five_min_avg=2.38, fifteen_min_avg=2.39, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:42:45.283 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8006704, partition_space_available_1k=73083780, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51844, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6332916, free=2017388, buffers=277352, cached=7547972, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.28, five_min_avg=2.33, fifteen_min_avg=2.37, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:43:45.269 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8010148, partition_space_available_1k=73080336, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22984, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6336256, free=2010528, buffers=277352, cached=7551492, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.25, five_min_avg=2.33, fifteen_min_avg=2.37, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:44:45.277 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8020520, partition_space_available_1k=73069964, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6313924, free=2026844, buffers=277352, cached=7557508, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=2.36, fifteen_min_avg=2.38, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:45:45.281 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8027228, partition_space_available_1k=73063256, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23012, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6310736, free=2023384, buffers=277372, cached=7564136, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=2.34, fifteen_min_avg=2.37, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:46:45.300 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8031900, partition_space_available_1k=73058584, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23148, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19832, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6320436, free=2008604, buffers=277372, cached=7569216, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.43, five_min_avg=2.39, fifteen_min_avg=2.38, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:47:45.329 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8049372, partition_space_available_1k=73041112, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22948, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19836, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6252700, free=2053564, buffers=277376, cached=7591988, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.03, five_min_avg=2.28, fifteen_min_avg=2.34, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:48:45.324 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8056668, partition_space_available_1k=73033816, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22844, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19836, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6264400, free=2034408, buffers=277392, cached=7599428, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.9, five_min_avg=2.19, fifteen_min_avg=2.31, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:49:45.338 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8063884, partition_space_available_1k=73026600, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22612, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19836, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51860, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6275772, free=2020572, buffers=277396, cached=7601888, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.01, five_min_avg=2.17, fifteen_min_avg=2.29, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:50:45.338 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8066908, partition_space_available_1k=73023576, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22672, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19836, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6265316, free=2023188, buffers=277400, cached=7609724, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.31, five_min_avg=2.22, fifteen_min_avg=2.3, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:51:45.343 7f85d6d3edf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8072908, partition_space_available_1k=73017576, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22776, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19836, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24116, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6265024, free=2017372, buffers=277400, cached=7615832, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.45, five_min_avg=2.26, fifteen_min_avg=2.31, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:52:46.844 7f85d14f6348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:52:46.844 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.846 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:52:46.847 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:52:46.847 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:52:46.847 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:46.847 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:46.864 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:52:46.864 7f85d14f6348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:52:46.865 7f85d1782648 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:52:46.865 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:52:46.865 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:52:46.865 7f85d1782648 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:52:46.866 7f85d1782648 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:52:46.866 7f85d1782e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:46.867 7f85d1782e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:55.502 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 01:52:55.502 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 01:52:55.502 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 01:52:55.544 7fe96f1e0648 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 03/20/2025 01:52:55.544 7fe96f1e0648 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 03/20/2025 01:52:55.545 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 01:52:55.551 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:52:55.551 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 01:52:55.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.270 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 100495392398258279483631133929605425412755585540200834849547261743112824736813, 'start': '1742435570000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 7124078737585030973113829437109823643995902238130649495792814851826016723623, 'start': '1742435569000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 100536229914135557039390863118733383562571107457811142242632743435169079607332, 'start': '1742435569000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 44206349440039176877191457947539869765475461721221271147911398195871188796644, 'start': '1742435569000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/20/2025 01:52:56.828 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435576828463, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:52:56.829 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435576829288, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435570000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:52:56.840 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.846 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 03/20/2025 01:52:56.846 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.846 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.848 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:52:56.848 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.848 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:56.848 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435570000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/20/2025 01:52:56.848 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:59.552 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:59.557 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:52:59.558 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:52:59.558 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:52:59.558 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:59.558 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:53:03.207 7fe96ddec348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:53:03.207 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 01:53:03.207 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 01:53:03.207 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:03.207 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 01:53:03.207 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:03.208 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:03.208 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/20/2025 01:53:03.208 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:04.332 7fe974ff1f20 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435584332611, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435570000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:53:04.333 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7918932, partition_space_available_1k=73171552, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13512, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21808, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43816, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=4318604, free=4135772, buffers=277540, cached=7443712, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=11.27, five_min_avg=4.34, fifteen_min_avg=2.99, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435570000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435569000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 7918932 partition_space_available_1k = 73171552 percentage_partition_space_used = 10 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 13852 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 13512 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21808 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 43816 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175628 used = 4318604 free = 4135772 buffers = 277540 cached = 7443712 node_type = control-node >> system_cpu_usage = << one_min_avg = 11.27 five_min_avg = 4.34 fifteen_min_avg = 2.99 cpu_share = 0 node_type = control-node >> >> 03/20/2025 01:53:04.333 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:07.208 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:53:07.210 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:53:07.210 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:53:07.210 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:53:07.210 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:53:07.211 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:53:07.216 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:53:07.217 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:53:07.217 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:53:07.217 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:53:07.218 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:53:07.218 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:53:07.218 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:53:07.219 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:07.221 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:54:04.215 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8823560, partition_space_available_1k=72266924, percentage_partition_space_used=11, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20844, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19124, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25708, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43972, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5265012, free=2077580, buffers=316880, cached=8516156, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=17.93, five_min_avg=7.62, fifteen_min_avg=4.21, cpu_share=24.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:55:04.238 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=9803372, partition_space_available_1k=71287112, percentage_partition_space_used=12, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21560, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19604, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25708, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5772628, free=337552, buffers=385436, cached=9680012, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=11.13, five_min_avg=7.64, fifteen_min_avg=4.44, cpu_share=18.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:55:46.011 7fe96ddec348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:55:46.012 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:46.013 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:55:46.014 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:55:46.014 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:55:46.014 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:46.014 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:46.125 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:55:46.127 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:55:46.128 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:55:46.132 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:55:46.133 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:55:46.134 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:55:46.136 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:55:46.137 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:55:46.141 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:55:46.221 7fe96ddec348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:55:46.222 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 03/20/2025 01:55:46.223 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:55:46.224 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 03/20/2025 01:55:46.224 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:55:46.225 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:46.226 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:46.355 7fe96ddec348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:55:46.356 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 01:55:46.356 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 01:55:46.356 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:46.357 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 01:55:46.357 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:46.357 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:46.357 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:55:46.357 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:50.357 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:55:50.359 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:55:50.360 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:55:50.361 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:55:50.361 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:50.361 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:55:58.653 7fe96ddec348 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:55:58.654 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 01:55:58.654 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 01:55:58.654 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:58.655 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 01:55:58.655 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:58.655 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:55:58.655 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:55:58.655 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:02.655 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:02.659 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:02.661 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:02.661 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:02.661 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:02.661 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:02.661 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:02.662 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:02.663 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:04.338 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10355064, partition_space_available_1k=70735420, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22620, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20476, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25708, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44020, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=4970448, free=1023308, buffers=387392, cached=9794480, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.76, five_min_avg=7.14, fifteen_min_avg=4.47, cpu_share=12.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:56:04.339 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:04.339 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10355064 partition_space_available_1k = 70735420 percentage_partition_space_used = 13 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 22620 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 20476 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 25708 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 44020 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175628 used = 4970448 free = 1023308 buffers = 387392 cached = 9794480 node_type = control-node >> system_cpu_usage = << one_min_avg = 6.76 five_min_avg = 7.14 fifteen_min_avg = 4.47 cpu_share = 12.0 node_type = control-node >> >> 03/20/2025 01:56:04.339 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:06.660 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:06.662 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:06.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:06.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:06.662 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:06.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:06.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:06.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:06.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:06.664 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:06.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:06.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:06.665 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:06.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:10.662 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:10.664 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:10.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:10.664 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:10.665 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:14.667 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:14.668 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:14.669 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:18.670 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:18.672 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:18.673 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:22.675 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:22.676 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:22.676 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:22.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:22.678 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:22.678 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:26.677 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:26.678 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:26.679 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:26.679 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:26.679 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:26.679 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:26.679 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:26.680 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:30.679 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:30.686 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:30.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:30.688 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:34.687 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:34.688 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:34.688 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:34.689 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:34.690 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:34.690 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:34.690 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:34.690 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:34.690 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:38.692 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:38.693 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:38.694 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:38.694 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:38.694 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:38.694 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:38.694 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:38.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:42.695 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:42.696 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:42.697 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:42.697 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:42.697 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:42.697 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:42.697 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:42.698 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:46.697 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:46.699 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:46.699 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:46.700 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:46.701 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:46.701 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:46.701 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:46.701 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:50.700 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:50.702 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:50.703 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:54.704 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:54.706 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:54.707 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:58.712 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:56:58.714 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:56:58.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:02.715 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:02.716 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:02.717 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:04.739 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10262180, partition_space_available_1k=70828304, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20924, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25708, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44072, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=4601252, free=1445092, buffers=391928, cached=9737356, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.6, five_min_avg=6.1, fifteen_min_avg=4.28, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:57:04.739 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:04.740 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10262180 partition_space_available_1k = 70828304 percentage_partition_space_used = 13 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 23884 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 20924 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 25708 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 44072 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175628 used = 4601252 free = 1445092 buffers = 391928 cached = 9737356 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.6 five_min_avg = 6.1 fifteen_min_avg = 4.28 cpu_share = 5.5 node_type = control-node >> >> 03/20/2025 01:57:04.740 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.718 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:06.719 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:06.719 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:06.719 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:06.720 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:06.721 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:10.719 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:10.721 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:10.721 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:10.721 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:10.722 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:10.722 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:10.722 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:10.722 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:10.722 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:10.723 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:10.723 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:10.723 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:10.723 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:10.723 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:14.723 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:14.724 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:14.724 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:14.725 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:14.726 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:14.726 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:14.726 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:18.727 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:18.730 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:18.731 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:18.731 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:18.731 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:18.731 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:18.731 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:22.731 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:22.733 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:22.734 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:26.735 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:26.736 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:26.737 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:30.739 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:30.741 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:30.742 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:34.743 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:34.745 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:34.746 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:38.748 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:38.750 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:38.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:42.751 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:42.752 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:42.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:42.754 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:42.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:42.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:42.754 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1742435575551824 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:57:42.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:46.753 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:46.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:57:46.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:46.754 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:57:46.755 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:46.756 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:47.461 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 03/20/2025 01:57:47.461 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:47.462 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:57:47.462 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:57:47.462 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:57:47.462 7fe96f1e0e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:47.462 7fe96f1e0e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:57:47.462 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:47.464 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:57.941 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 03/20/2025 01:57:57.942 7fe96ddec348 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:57.942 7fe96de24348 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 01:57:57.943 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 03/20/2025 01:57:57.943 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:57:57.943 7fe96de24348 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:58:04.734 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10383276, partition_space_available_1k=70707208, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24484, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21356, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25708, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44212, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6042024, free=268544, buffers=393708, cached=9471352, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.64, five_min_avg=5.58, fifteen_min_avg=4.21, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:59:02.086 7fe96ddec148 [contrail-control-nodemgr] [DEBUG]: DBG: event_process_state:contrail-control,group:contrail-control,state:PROCESS_STATE_EXITED 03/20/2025 01:59:02.087 7fe96ddec148 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435942087440, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435570000000', last_stop_time='', last_exit_time='1742435942087340', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:02.091 7fe96ddec148 [contrail-control-nodemgr] [DEBUG]: DBG: event_process_state:contrail-dns,group:contrail-dns,state:PROCESS_STATE_EXITED 03/20/2025 01:59:02.091 7fe96ddec148 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435942091678, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435570000000', last_stop_time='', last_exit_time='1742435942087340', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435569000000', last_stop_time='', last_exit_time='1742435942091571', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:02.095 7fe96ddec148 [contrail-control-nodemgr] [DEBUG]: DBG: event_process_state:contrail-named,group:contrail-named,state:PROCESS_STATE_EXITED 03/20/2025 01:59:02.095 7fe96ddec148 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435942095761, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435570000000', last_stop_time='', last_exit_time='1742435942087340', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435569000000', last_stop_time='', last_exit_time='1742435942091571', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1742435569000000', last_stop_time='', last_exit_time='1742435942095700', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435569000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-03-17 01:12:14.132392", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8139-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:02.097 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:59:02.098 7fe96de24348 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:59:02.695 7fe974ff1f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10819084, partition_space_available_1k=70271400, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24552, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21396, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=0, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44312, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5956116, free=257688, buffers=405560, cached=9556264, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.67, five_min_avg=5.24, fifteen_min_avg=4.18, cpu_share=9.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 01:59:32.782 7fcff4be3908 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 01:59:32.783 7fcff4be3908 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 01:59:32.784 7fcff4be3908 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 01:59:32.797 7fcff0f300f0 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 03/20/2025 01:59:32.797 7fcff0f300f0 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 03/20/2025 01:59:32.799 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 01:59:32.800 7fcff0f32a20 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:59:32.801 7fcff0f32a20 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:59:32.801 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 01:59:32.801 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:32.802 7fcff0f32a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:59:32.802 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:32.802 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:32.802 7fcff0f32a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1742435972800947 collector_name = collector_ip = collector_list = [ 10.0.0.42:8086, 10.0.0.12:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 01:59:32.802 7fcff0f32a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:32.940 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 88042654832724588362047413759327632808077898612596246091566810682355795413768, 'start': '1742435970000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 106056845092944404765587829984414660063573398699213383610858114645286080403362, 'start': '1742435970000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 93052757220479929014704422930160681792801350121898261951668916873514865779770, 'start': '1742435970000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 54221518590283813649935092503720740204440551251966371216751036905092549224283, 'start': '1742435970000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/20/2025 01:59:33.109 7fcff4be3908 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435973109496, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:33.110 7fcff4be3908 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435973110202, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-20 00:47:32.457292", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8220-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:33.113 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:33.114 7fcffaec4a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-20 00:47:32.457292", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8220-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 03/20/2025 01:59:33.114 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:33.114 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:33.115 7fcffaec4a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:59:33.115 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:33.115 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:33.115 7fcffaec4a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435970000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435970000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435970000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742435970000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-20 00:47:32.457292", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8220-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/20/2025 01:59:33.115 7fcffaec4a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:59:36.801 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:59:36.803 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:59:36.804 7fcff45e9ac8 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/20/2025 01:59:36.804 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:59:36.804 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:59:36.804 7fcff45e9ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:59:36.813 7fcff45d9780 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:59:36.813 7fcff45d9780 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:59:36.814 7fcff45e9198 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:59:36.814 7fcff45e9198 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:59:36.814 7fcff45e9198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 01:59:36.814 7fcff45e9198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:59:36.814 7fcff45e9198 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:59:36.815 7fcff2814ac8 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:59:36.816 7fcff2814ac8 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:59:40.150 7fcff4be3908 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2923-2', _node_type='Control', _instance_id='0', _timestamp=1742435980150522, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742435970000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-20 00:47:32.457292", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8220-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 03/20/2025 01:59:40.151 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10842676, partition_space_available_1k=70247808, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16352, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15208, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52404, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6008700, free=257688, buffers=406304, cached=9502936, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.11, five_min_avg=4.92, fifteen_min_avg=4.11, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:00:40.155 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10847156, partition_space_available_1k=70243328, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17564, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15592, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52476, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6010832, free=250748, buffers=406356, cached=9507692, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.38, five_min_avg=4.08, fifteen_min_avg=3.87, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:01:40.164 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10846560, partition_space_available_1k=70243924, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17948, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15880, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52460, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6096580, free=223324, buffers=405388, cached=9450336, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.04, five_min_avg=3.48, fifteen_min_avg=3.67, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:02:40.179 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11630688, partition_space_available_1k=69459796, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18192, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17312, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52120, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=3855576, free=2542624, buffers=416156, cached=9361272, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.35, five_min_avg=3.13, fifteen_min_avg=3.54, cpu_share=9.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:03:40.210 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12031884, partition_space_available_1k=69058600, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18600, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17616, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52124, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5347096, free=558616, buffers=431612, cached=9838304, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.98, five_min_avg=3.6, fifteen_min_avg=3.68, cpu_share=15.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:04:40.213 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12057180, partition_space_available_1k=69033304, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19112, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17932, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52164, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5480660, free=412232, buffers=431660, cached=9851076, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.7, five_min_avg=3.35, fifteen_min_avg=3.59, cpu_share=9.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:05:40.214 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12062412, partition_space_available_1k=69028072, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19164, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18096, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52132, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5857272, free=197856, buffers=431124, cached=9689376, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.46, five_min_avg=3.23, fifteen_min_avg=3.53, cpu_share=6.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:06:40.226 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12065936, partition_space_available_1k=69024548, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19040, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18120, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52132, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5881100, free=197840, buffers=430700, cached=9665988, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.29, five_min_avg=2.74, fifteen_min_avg=3.35, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:07:40.222 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12069308, partition_space_available_1k=69021176, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19168, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18176, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52128, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5896964, free=214088, buffers=430676, cached=9633900, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.56, five_min_avg=2.52, fifteen_min_avg=3.23, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:08:40.234 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12074888, partition_space_available_1k=69015596, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19156, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18180, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52136, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5910508, free=214192, buffers=430616, cached=9620312, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.52, five_min_avg=2.31, fifteen_min_avg=3.11, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:09:40.259 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12074428, partition_space_available_1k=69016056, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19008, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18196, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52144, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5871692, free=264576, buffers=430456, cached=9608904, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.0, five_min_avg=2.02, fifteen_min_avg=2.96, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:10:40.245 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12077856, partition_space_available_1k=69012628, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19292, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18216, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5907760, free=225152, buffers=430456, cached=9612260, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.56, five_min_avg=1.71, fifteen_min_avg=2.79, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:11:40.246 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12081236, partition_space_available_1k=69009248, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19192, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18216, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52148, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5919764, free=209768, buffers=430460, cached=9615636, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.66, five_min_avg=1.54, fifteen_min_avg=2.67, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:12:40.255 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12084784, partition_space_available_1k=69005700, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19092, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18224, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5930296, free=212776, buffers=430384, cached=9602172, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.73, five_min_avg=1.41, fifteen_min_avg=2.55, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:13:40.260 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12088184, partition_space_available_1k=69002300, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19176, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18228, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52144, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5937280, free=204772, buffers=430384, cached=9603192, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.8, five_min_avg=1.33, fifteen_min_avg=2.45, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:14:40.277 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12092508, partition_space_available_1k=68997976, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19296, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18244, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5957584, free=206428, buffers=430088, cached=9581528, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.73, five_min_avg=1.24, fifteen_min_avg=2.35, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:15:40.272 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12095720, partition_space_available_1k=68994764, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19612, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18252, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52140, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5961408, free=204812, buffers=430044, cached=9579364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.64, five_min_avg=1.13, fifteen_min_avg=2.24, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:16:40.269 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12098844, partition_space_available_1k=68991640, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19500, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18264, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52144, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5978704, free=197800, buffers=429948, cached=9569176, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.8, five_min_avg=1.09, fifteen_min_avg=2.16, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:17:12.143 7fcff1bd8198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:17:36.745 7fcff45f8390 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:17:40.274 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12456196, partition_space_available_1k=68634288, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18288, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52036, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5957528, free=258384, buffers=433580, cached=9526136, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.25, five_min_avg=1.17, fifteen_min_avg=2.11, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:17:52.688 7fcff1bce6d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:18:07.956 7fcff45df390 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:18:40.279 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12460404, partition_space_available_1k=68630080, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19864, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18356, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52024, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5971476, free=261700, buffers=433684, cached=9508768, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.45, five_min_avg=1.26, fifteen_min_avg=2.08, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:18:41.343 7fcff0f2aa20 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:19:40.292 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12467720, partition_space_available_1k=68622764, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19924, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18356, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52024, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=5966652, free=291440, buffers=433548, cached=9483988, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.66, five_min_avg=1.06, fifteen_min_avg=1.96, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:20:01.597 7fcff1bd06d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:20:40.282 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12468592, partition_space_available_1k=68621892, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20448, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18528, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52016, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6036048, free=212520, buffers=433668, cached=9493392, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.03, five_min_avg=1.38, fifteen_min_avg=2.01, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:21:40.301 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12482628, partition_space_available_1k=68607856, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18972, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52024, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6024692, free=222456, buffers=433264, cached=9495216, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.22, five_min_avg=1.72, fifteen_min_avg=2.08, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:22:40.294 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12498684, partition_space_available_1k=68591800, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22904, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19424, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52024, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6053116, free=206880, buffers=432692, cached=9482940, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.13, five_min_avg=2.04, fifteen_min_avg=2.17, cpu_share=9.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:23:40.303 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12509164, partition_space_available_1k=68581320, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23856, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19672, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52028, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6087588, free=214828, buffers=432524, cached=9440688, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.65, five_min_avg=1.82, fifteen_min_avg=2.09, cpu_share=8.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:24:40.323 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12523408, partition_space_available_1k=68567076, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25100, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19964, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16880, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52036, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6088828, free=205968, buffers=432516, cached=9448316, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.47, five_min_avg=1.76, fifteen_min_avg=2.05, cpu_share=7.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:25:40.332 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12532132, partition_space_available_1k=68558352, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25656, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16884, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52028, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6115080, free=221352, buffers=432460, cached=9406736, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.03, five_min_avg=1.58, fifteen_min_avg=1.97, cpu_share=6.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:26:40.333 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12555428, partition_space_available_1k=68535056, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26388, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20360, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16884, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52028, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6175660, free=206040, buffers=432436, cached=9361492, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.48, five_min_avg=1.63, fifteen_min_avg=1.96, cpu_share=7.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:27:14.580 7fcff1bb12e8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:27:40.342 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12562436, partition_space_available_1k=68528048, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26736, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20560, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16884, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52024, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6189256, free=214568, buffers=432412, cached=9339392, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.66, five_min_avg=1.9, fifteen_min_avg=2.03, cpu_share=8.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 03/20/2025 02:28:39.514 7fcff1bcef60 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 03/20/2025 02:28:40.387 7fcff4be3908 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2923-2', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12566656, partition_space_available_1k=68523828, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26924, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20568, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16884, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52020, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175628, used=6188136, free=226344, buffers=432228, cached=9328920, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=1.95, fifteen_min_avg=2.04, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter')