09/09/2024 02:45:20.665 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/09/2024 02:45:20.665 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/09/2024 02:45:20.666 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/09/2024 02:45:20.673 7fbb54263748 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 09/09/2024 02:45:20.674 7fbb54263748 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 09/09/2024 02:45:20.675 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/09/2024 02:45:20.675 7fbb543fd048 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:20.676 7fbb543fd048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/09/2024 02:45:20.677 7fbb543fd048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:20.923 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 115617032190667066330864135190350122835994437031073176570451178899366763789847, 'start': '1725849918000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 980471089241496951152647697184912910834243134749754489436541743393807075262, 'start': '1725849918000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 84402726041211487818456844346945846427452034989621428481275861069929171253249, 'start': '1725849919000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 9078066975585612761541333757102889512458479510594890453004810214270351538807, 'start': '1725849918000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/09/2024 02:45:21.067 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1870-1', _node_type='Control', _instance_id='0', _timestamp=1725849921067384, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 09/09/2024 02:45:21.068 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1870-1', _node_type='Control', _instance_id='0', _timestamp=1725849921068301, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849919000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 09/09/2024 02:45:21.072 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:21.073 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:21.074 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849919000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 09/09/2024 02:45:21.074 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:24.675 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:24.677 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:24.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.134 7fbb599efaf8 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-1870-1', _node_type='Control', _instance_id='0', _timestamp=1725849928134643, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849919000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1725849918000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 09/09/2024 02:45:28.135 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15900876, partition_space_available_1k=65189608, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13696, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13352, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=31676, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50852, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6280188, free=9773688, buffers=675520, cached=15935724, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.13, five_min_avg=2.53, fifteen_min_avg=1.74, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:45:28.135 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.135 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849919000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1725849918000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-09-09 01:13:25.299192", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-5233-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 09/09/2024 02:45:28.135 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.136 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.136 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15900876 partition_space_available_1k = 65189608 percentage_partition_space_used = 20 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 13696 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 13352 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 31676 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50852 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 6280188 free = 9773688 buffers = 675520 cached = 15935724 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.13 five_min_avg = 2.53 fifteen_min_avg = 1.74 cpu_share = 0 node_type = control-node >> >> 09/09/2024 02:45:28.136 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.678 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:28.679 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:28.680 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:32.679 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:32.681 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:32.682 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:36.681 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:36.683 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:36.684 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:40.689 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:40.701 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:40.702 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:40.707 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:40.708 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:40.713 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:40.713 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:40.713 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:40.713 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:40.713 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:40.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:40.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:40.724 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:40.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:44.703 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:44.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:44.706 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:48.705 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:48.707 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:48.707 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:48.707 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:48.707 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:48.712 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:48.712 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:48.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:48.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:48.718 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:48.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:48.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:48.719 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:48.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:52.707 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:52.708 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:52.709 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:52.710 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:52.710 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:52.710 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:52.710 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:52.710 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:56.712 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:45:56.714 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:45:56.715 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:45:56.716 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:00.716 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:00.718 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:00.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:04.719 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:04.721 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:04.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:08.722 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:08.723 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:08.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:08.725 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:08.725 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:08.725 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:12.724 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:12.726 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:12.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:16.726 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:16.727 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:16.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:16.727 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:16.727 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:16.728 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:20.731 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:20.732 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:20.732 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:20.732 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:20.732 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:20.732 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:20.733 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:24.732 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:24.734 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:24.734 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:24.734 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:24.734 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:24.734 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:24.735 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.116 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16282980, partition_space_available_1k=64807504, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14340, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13516, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=31676, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51124, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=7516824, free=8233352, buffers=699888, cached=16215056, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.41, five_min_avg=2.74, fifteen_min_avg=1.86, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:46:28.117 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.117 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16282980 partition_space_available_1k = 64807504 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 14340 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 13516 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 31676 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 51124 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 7516824 free = 8233352 buffers = 699888 cached = 16215056 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.41 five_min_avg = 2.74 fifteen_min_avg = 1.86 cpu_share = 3.12 node_type = control-node >> >> 09/09/2024 02:46:28.117 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.734 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:28.736 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:28.737 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:32.737 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:32.738 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:32.739 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:36.741 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:36.742 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:36.743 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:40.744 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:40.751 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:40.751 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:40.751 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:40.757 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:40.757 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:40.757 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:40.758 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:44.754 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:44.759 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:44.760 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:44.761 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:44.761 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:44.761 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:44.761 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:44.761 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:48.763 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:48.765 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:48.766 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:48.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:52.765 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:52.766 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:52.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:52.766 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:52.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:56.767 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:46:56.768 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:46:56.769 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:56.770 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:46:56.770 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:46:56.770 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:00.771 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:47:00.773 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:47:00.774 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:04.776 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:47:04.777 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:04.778 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:04.779 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:47:04.779 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:08.779 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:47:08.780 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/09/2024 02:47:08.780 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:47:08.780 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:08.780 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:47:08.780 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1725849920676005 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/09/2024 02:47:08.781 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/09/2024 02:47:12.792 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/09/2024 02:47:12.793 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 09/09/2024 02:47:12.798 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/09/2024 02:47:12.798 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-1870-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:47:12.799 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/09/2024 02:47:22.459 7fbb54341448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 09/09/2024 02:47:22.459 7fbb54341448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/09/2024 02:47:22.460 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/09/2024 02:47:22.460 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 09/09/2024 02:47:22.460 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:47:22.460 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:47:22.461 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/09/2024 02:47:22.461 7fbb543fd148 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/09/2024 02:47:22.462 7fbb543fd148 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/09/2024 02:47:28.175 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16613288, partition_space_available_1k=64477196, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14688, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14012, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=31676, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51320, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=7704780, free=7709276, buffers=706464, cached=16544600, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.55, five_min_avg=2.82, fifteen_min_avg=1.94, cpu_share=3.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:47:35.569 7fbb54341448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 09/09/2024 02:47:35.569 7fbb54341448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/09/2024 02:47:35.570 7fbb543fd448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/09/2024 02:47:35.570 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 09/09/2024 02:47:35.570 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:47:35.570 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/09/2024 02:48:28.128 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17620872, partition_space_available_1k=63469612, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15068, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14192, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=31556, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43536, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8852160, free=20426380, buffers=734572, cached=2652008, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.01, five_min_avg=3.45, fifteen_min_avg=2.22, cpu_share=5.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:49:28.139 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17645300, partition_space_available_1k=63445184, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12632, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11612, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43556, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9368404, free=19775512, buffers=738500, cached=2782704, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.3, five_min_avg=3.51, fifteen_min_avg=2.31, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:49:39.381 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:49:51.695 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:50:03.968 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:50:16.241 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:50:28.140 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18131652, partition_space_available_1k=62958832, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13440, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11772, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44008, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9420224, free=19238420, buffers=743792, cached=3262684, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.21, five_min_avg=3.93, fifteen_min_avg=2.53, cpu_share=3.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:50:28.780 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:50:40.975 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:50:53.145 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:51:05.368 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:51:17.723 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:51:28.127 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18137744, partition_space_available_1k=62952740, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11948, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44036, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9334068, free=19319280, buffers=743872, cached=3267900, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.33, five_min_avg=3.86, fifteen_min_avg=2.6, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:51:30.306 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:51:42.892 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:51:55.116 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:52:07.298 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:52:19.608 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:52:28.132 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18152668, partition_space_available_1k=62937816, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14372, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12384, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44196, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9357560, free=19288304, buffers=743940, cached=3275316, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.29, five_min_avg=3.63, fifteen_min_avg=2.6, cpu_share=3.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:52:32.270 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:52:44.504 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:52:56.598 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:53:08.809 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:53:20.985 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:53:28.136 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18163460, partition_space_available_1k=62927024, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14664, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12572, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44056, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9490592, free=19147700, buffers=744008, cached=3282820, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.4, five_min_avg=3.87, fifteen_min_avg=2.74, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:53:33.858 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:53:46.123 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:53:58.350 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:54:10.568 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:54:22.697 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:54:28.162 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18165888, partition_space_available_1k=62924596, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14960, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12744, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44056, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9395028, free=19234932, buffers=744256, cached=3290904, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.74, five_min_avg=3.76, fifteen_min_avg=2.77, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:54:35.356 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:54:47.557 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:54:59.814 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:55:11.979 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:55:24.056 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:55:28.153 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18172476, partition_space_available_1k=62918008, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15340, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12904, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44060, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9442652, free=19181536, buffers=744348, cached=3296584, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.95, five_min_avg=3.84, fifteen_min_avg=2.87, cpu_share=3.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:55:36.772 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:55:48.985 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:56:01.063 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:56:13.272 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:56:25.538 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:56:28.150 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18178692, partition_space_available_1k=62911792, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15640, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13088, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44060, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9389324, free=19228620, buffers=744416, cached=3302760, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.32, five_min_avg=3.66, fifteen_min_avg=2.86, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:56:38.265 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:56:50.415 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:57:02.654 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:57:14.873 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:57:27.414 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:57:28.151 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18185380, partition_space_available_1k=62905104, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16092, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13268, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44064, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9402280, free=19208276, buffers=744476, cached=3310088, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.61, five_min_avg=3.65, fifteen_min_avg=2.91, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:57:39.963 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:57:52.373 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:58:05.239 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:58:17.618 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:58:28.148 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18192360, partition_space_available_1k=62898124, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16516, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13696, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44068, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9414564, free=19188792, buffers=744520, cached=3317244, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.59, five_min_avg=3.34, fifteen_min_avg=2.85, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:58:29.886 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:58:42.357 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:58:54.489 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:59:06.743 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:59:18.949 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:59:28.149 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18198260, partition_space_available_1k=62892224, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16548, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13872, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44072, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9426084, free=19170464, buffers=744576, cached=3323996, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.07, five_min_avg=3.35, fifteen_min_avg=2.89, cpu_share=3.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 02:59:31.192 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:59:43.783 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 02:59:55.922 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:00:08.365 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:00:20.650 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:00:28.198 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18204668, partition_space_available_1k=62885816, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14032, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44092, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9511956, free=19078056, buffers=744600, cached=3330508, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.01, five_min_avg=3.28, fifteen_min_avg=2.89, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 03:00:33.007 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:00:45.511 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:00:57.866 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:01:10.427 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:01:22.669 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:01:28.156 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18211152, partition_space_available_1k=62879332, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17128, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14232, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44132, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9447016, free=19135800, buffers=744656, cached=3337648, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.07, five_min_avg=3.27, fifteen_min_avg=2.92, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 03:01:34.804 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:01:47.272 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:01:59.712 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:02:02.039 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:02:04.561 7fbb543fd448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 09/09/2024 03:02:28.159 7fbb599efaf8 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-1870-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18217648, partition_space_available_1k=62872836, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17412, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14408, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=32404, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44136, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9425672, free=19150712, buffers=744700, cached=3344036, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.52, five_min_avg=3.07, fifteen_min_avg=2.87, cpu_share=3.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 09/09/2024 03:02:46.989 7fbb543fd148 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map