04/28/2025 01:36:57.603 7fef84ca1048 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 04/28/2025 01:36:57.603 7fef84ca1048 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 04/28/2025 01:36:57.603 7fef84ca1048 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 04/28/2025 01:36:57.615 7fef812b80f0 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 04/28/2025 01:36:57.616 7fef812b80f0 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 04/28/2025 01:36:57.616 7fef812bda20 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 04/28/2025 01:36:57.618 7fef812bda20 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.619 7fef812bda20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 04/28/2025 01:36:57.620 7fef812bda20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.774 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 25041255049285252856268133453658877717722125681099226115130715247679732712089, 'start': '1745804214000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 69142785409885887884521020291507611962370450655120583311035525620163680487642, 'start': '1745804214000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 57871995192810345451888442413925183776710851536491738530107893302892430189256, 'start': '1745804214000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 18781271222380126454380714017795818142746962426847730827868316747642548484244, 'start': '1745804214000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 04/28/2025 01:36:57.987 7fef84ca1048 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1199-1', _node_type='Control', _instance_id='0', _timestamp=1745804217987210, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 04/28/2025 01:36:57.987 7fef84ca1048 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1199-1', _node_type='Control', _instance_id='0', _timestamp=1745804217987716, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 04/28/2025 01:36:57.990 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.990 7fef8aebba20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 04/28/2025 01:36:57.990 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/28/2025 01:36:57.991 7fef8aebba20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:36:58.610 7fef829aed68 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:37:01.619 7fef82598e10 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:01.620 7fef82598e10 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:01.620 7fef82598e10 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:01.620 7fef82598e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:01.621 7fef82598e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:05.623 7fef82579e10 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:05.624 7fef82579e10 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:05.625 7fef82579e10 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:06.004 7fef84ca1048 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1199-1', _node_type='Control', _instance_id='0', _timestamp=1745804226003985, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804214000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 04/28/2025 01:37:06.004 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10904412, partition_space_available_1k=70186072, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=8172, cpu_share=0, mem_res=4088, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=7512, cpu_share=0, mem_res=3636, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24436, cpu_share=0, mem_res=21000, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53024, cpu_share=0, mem_res=39192, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=3028944, free=1292536, buffers=443768, cached=11418960, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.02, five_min_avg=1.24, fifteen_min_avg=0.55, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804214000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10904412 partition_space_available_1k = 70186072 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 8172 cpu_share = 0 mem_res = 4088 >>contrail-dns : << mem_virt = 7512 cpu_share = 0 mem_res = 3636 >>contrail-named : << mem_virt = 24436 cpu_share = 0 mem_res = 21000 >>contrail-control-nodemgr : << mem_virt = 53024 cpu_share = 0 mem_res = 39192 >> } system_mem_usage = << total = 16184208 used = 3028944 free = 1292536 buffers = 443768 cached = 11418960 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.02 five_min_avg = 1.24 fifteen_min_avg = 0.55 cpu_share = 0 node_type = control-node >> >> 04/28/2025 01:37:06.004 7fef82594588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:09.627 7fef829a9780 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:09.628 7fef829a9780 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:09.629 7fef829a9780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:13.629 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:13.630 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:13.631 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:13.631 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:17.631 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:17.632 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:17.633 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:21.635 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:21.636 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:21.637 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:25.639 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:25.640 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:25.641 7fef812b8cc0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:29.642 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:29.643 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:29.644 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:33.647 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:33.650 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:33.650 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:33.650 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:33.650 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:33.651 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:37.652 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:37.653 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:37.654 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:41.655 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:41.656 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:41.657 7fef84a26b70 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:45.659 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:45.660 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:45.661 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:45.661 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:45.661 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:45.661 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:45.661 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:49.664 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:49.665 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:49.666 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:53.667 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:53.668 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:53.669 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:57.671 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:37:57.672 7fef82579d68 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:37:57.672 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:37:57.672 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:37:57.673 7fef82579d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:01.675 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:01.676 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:01.677 7fef812d24e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.677 7fef812d2390 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:05.678 7fef812d2390 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:05.678 7fef812d2390 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:05.678 7fef812d2390 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:05.678 7fef812d2390 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.679 7fef812d2390 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.680 7fef812d2390 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:05.680 7fef812d2390 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.979 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10947108, partition_space_available_1k=70143376, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16088, cpu_share=0.25, mem_res=11248, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15916, cpu_share=0.75, mem_res=11024, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53260, cpu_share=0.0, mem_res=39256, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=3879440, free=297380, buffers=460504, cached=11546884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.96, five_min_avg=1.87, fifteen_min_avg=0.81, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:38:05.980 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:05.980 7fef8561ec18 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10947108 partition_space_available_1k = 70143376 percentage_partition_space_used = 13 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 16088 cpu_share = 0.25 mem_res = 11248 >>contrail-dns : << mem_virt = 15916 cpu_share = 0.75 mem_res = 11024 >>contrail-named : << mem_virt = 28468 cpu_share = 0.0 mem_res = 25080 >>contrail-control-nodemgr : << mem_virt = 53260 cpu_share = 0.0 mem_res = 39256 >> } system_mem_usage = << total = 16184208 used = 3879440 free = 297380 buffers = 460504 cached = 11546884 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.96 five_min_avg = 1.87 fifteen_min_avg = 0.81 cpu_share = 13.25 node_type = control-node >> >> 04/28/2025 01:38:05.980 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:09.681 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:09.681 7fef8561ec18 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:09.682 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:09.683 7fef8561ec18 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:09.683 7fef8561ec18 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:13.682 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:13.683 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:13.684 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:17.686 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:17.688 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:17.689 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:17.689 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:17.689 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:21.690 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:21.691 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:21.692 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:25.695 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:25.696 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:25.697 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:25.697 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:25.697 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:25.697 7fef8483f2e8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:25.697 7fef8483f2e8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:29.697 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:29.698 7fef82989588 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:29.698 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:29.698 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:29.698 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:29.698 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:29.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:33.699 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:33.700 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:33.701 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:37.704 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:37.705 7fef82989588 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:37.705 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:37.705 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:37.706 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:41.707 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:41.708 7fef82989588 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:41.708 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:41.708 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:41.709 7fef82989588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:45.712 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:45.713 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:45.714 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:45.714 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:45.714 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:49.716 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:49.717 7fef89e53780 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:49.717 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:49.717 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:49.718 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:53.722 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:53.723 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:53.724 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:57.727 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:38:57.728 7fef89e53780 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1745804217619143 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:38:57.729 7fef89e53780 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:39:01.731 7fef82598c18 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1199-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 04/28/2025 01:39:01.732 7fef82598c18 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 04/28/2025 01:39:01.733 7fef82598c18 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 04/28/2025 01:39:01.733 7fef82598c18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/28/2025 01:39:01.733 7fef82598c18 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/28/2025 01:39:01.735 7fef82584048 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 04/28/2025 01:39:01.736 7fef82584048 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/28/2025 01:39:01.736 7fef81d0dac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 04/28/2025 01:39:01.736 7fef81d0dac8 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 04/28/2025 01:39:01.736 7fef81d0dac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:01.736 7fef81d0dac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:39:01.737 7fef81d0dac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 04/28/2025 01:39:01.737 7fef8299d0f0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 04/28/2025 01:39:01.738 7fef8299d0f0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 04/28/2025 01:39:06.004 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10952592, partition_space_available_1k=70137892, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0.0, mem_res=11752, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16428, cpu_share=0.0, mem_res=11420, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53164, cpu_share=0.0, mem_res=39144, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=4243724, free=254848, buffers=450532, cached=11235104, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.75, five_min_avg=1.85, fifteen_min_avg=0.87, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:39:09.684 7fef86102c18 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:11.921 7fef82584048 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001293 04/28/2025 01:39:11.921 7fef82584048 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/28/2025 01:39:11.922 7fef825d0780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 04/28/2025 01:39:11.922 7fef825d0780 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 04/28/2025 01:39:11.922 7fef825d0780 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:11.922 7fef825d0780 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:39:20.648 7fef829a9588 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:46.867 7fef85614ac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:49.557 7fef85614ac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:39:53.518 7fef85614ac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:40:05.986 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11487132, partition_space_available_1k=69603352, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16960, cpu_share=0.0, mem_res=11996, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16716, cpu_share=0.0, mem_res=11684, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0.0, mem_res=39256, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6488836, free=325512, buffers=434444, cached=8935416, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.19, five_min_avg=2.82, fifteen_min_avg=1.27, cpu_share=15.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:40:21.447 7fef8112a780 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:41:06.002 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11504828, partition_space_available_1k=69585656, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17176, cpu_share=0.0, mem_res=12252, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16828, cpu_share=0.0, mem_res=11948, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52028, cpu_share=0.0, mem_res=39156, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6526164, free=367676, buffers=434116, cached=8856252, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=2.58, fifteen_min_avg=1.29, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:42:06.019 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11512524, partition_space_available_1k=69577960, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17220, cpu_share=0.0, mem_res=12252, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16880, cpu_share=0.0, mem_res=11948, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52116, cpu_share=0.0, mem_res=39492, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6510656, free=363956, buffers=435488, cached=8874108, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=2.48, fifteen_min_avg=1.33, cpu_share=9.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:42:54.790 7fef8065bcc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:42:57.452 7fef8065bcc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:43:02.137 7fef82584c18 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:43:06.047 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11521472, partition_space_available_1k=69569012, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17484, cpu_share=0.0, mem_res=12648, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16968, cpu_share=0.0, mem_res=11948, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52176, cpu_share=0.0, mem_res=39588, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6546228, free=313112, buffers=435644, cached=8889224, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.6, five_min_avg=2.5, fifteen_min_avg=1.42, cpu_share=9.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:44:06.035 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11530004, partition_space_available_1k=69560480, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17256, cpu_share=0.0, mem_res=12504, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16984, cpu_share=0.0, mem_res=11948, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52176, cpu_share=0.0, mem_res=39480, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6528180, free=322612, buffers=435772, cached=8897644, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.03, five_min_avg=2.35, fifteen_min_avg=1.43, cpu_share=7.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:44:10.390 7fef84c296d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:44:16.265 7fef84c296d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:44:21.498 7fef829a9198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:44:27.004 7fef829a9198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:44:30.503 7fef829a9198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:45:06.043 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11557992, partition_space_available_1k=69532492, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18828, cpu_share=0.25, mem_res=13548, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17768, cpu_share=0.25, mem_res=12608, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52208, cpu_share=0.0, mem_res=39356, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6649868, free=456548, buffers=429576, cached=8648216, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.93, five_min_avg=2.96, fifteen_min_avg=1.71, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:46:06.057 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11565264, partition_space_available_1k=69525220, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19644, cpu_share=0.0, mem_res=14316, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18004, cpu_share=0.0, mem_res=12740, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52384, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6680624, free=412264, buffers=430884, cached=8660436, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.38, five_min_avg=2.69, fifteen_min_avg=1.69, cpu_share=8.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:47:06.075 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11573572, partition_space_available_1k=69516912, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19912, cpu_share=0.0, mem_res=14580, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18208, cpu_share=0.0, mem_res=13004, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52288, cpu_share=0.0, mem_res=39684, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6733496, free=336084, buffers=433236, cached=8681392, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=2.84, fifteen_min_avg=1.81, cpu_share=9.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:47:49.952 7fef812d26d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:47:52.625 7fef812d26d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:47:56.735 7fef812d26d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:48:06.067 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11585460, partition_space_available_1k=69505024, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20548, cpu_share=0.0, mem_res=15100, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18364, cpu_share=0.0, mem_res=13136, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52424, cpu_share=0.0, mem_res=39724, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6752620, free=301016, buffers=433580, cached=8696992, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.14, five_min_avg=2.61, fifteen_min_avg=1.8, cpu_share=9.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:49:06.074 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11592468, partition_space_available_1k=69498016, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20576, cpu_share=0.0, mem_res=15232, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18496, cpu_share=0.0, mem_res=13268, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52480, cpu_share=0.0, mem_res=39624, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6702616, free=342480, buffers=433784, cached=8705328, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.6, five_min_avg=2.36, fifteen_min_avg=1.76, cpu_share=8.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:50:05.351 7fef825b0cc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:50:06.092 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11599856, partition_space_available_1k=69490628, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21108, cpu_share=0.0, mem_res=15600, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18556, cpu_share=0.0, mem_res=13268, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52604, cpu_share=0.0, mem_res=39624, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6734480, free=299368, buffers=433884, cached=8716476, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.65, five_min_avg=2.25, fifteen_min_avg=1.76, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:51:06.115 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11608272, partition_space_available_1k=69482212, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21256, cpu_share=0.0, mem_res=15732, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18600, cpu_share=0.0, mem_res=13400, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52568, cpu_share=0.0, mem_res=39644, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6790744, free=228828, buffers=434164, cached=8730472, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.24, five_min_avg=2.27, fifteen_min_avg=1.8, cpu_share=9.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:51:55.459 7fef8113f390 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:51:58.666 7fef82574198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:52:04.274 7fef82579198 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:52:06.139 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12329232, partition_space_available_1k=68761252, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21868, cpu_share=0.0, mem_res=16392, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18644, cpu_share=0.0, mem_res=13532, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52076, cpu_share=0.0, mem_res=39504, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6766216, free=182120, buffers=422052, cached=8813820, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.7, five_min_avg=2.54, fifteen_min_avg=1.91, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:53:06.107 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12772808, partition_space_available_1k=68317676, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22864, cpu_share=0.25, mem_res=17044, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19044, cpu_share=0.25, mem_res=13796, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0.0, mem_res=39480, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6929460, free=358104, buffers=428908, cached=8467736, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.54, five_min_avg=2.73, fifteen_min_avg=2.02, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:54:06.124 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12793184, partition_space_available_1k=68297300, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24668, cpu_share=0.25, mem_res=18216, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19712, cpu_share=0.25, mem_res=14324, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51832, cpu_share=0.0, mem_res=39420, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6949436, free=313744, buffers=429144, cached=8491884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.89, five_min_avg=2.96, fifteen_min_avg=2.14, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:54:38.873 7fef8065b438 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:55:06.138 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12799540, partition_space_available_1k=68290944, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25532, cpu_share=0.0, mem_res=18720, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19932, cpu_share=0.0, mem_res=14456, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51912, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6975500, free=242752, buffers=435116, cached=8530840, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=3.04, fifteen_min_avg=2.22, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:56:06.130 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12803260, partition_space_available_1k=68287224, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25944, cpu_share=0.0, mem_res=19116, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20068, cpu_share=0.0, mem_res=14588, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0.0, mem_res=39420, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6957652, free=335520, buffers=436064, cached=8454972, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.67, five_min_avg=2.9, fifteen_min_avg=2.22, cpu_share=9.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:57:06.151 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12806700, partition_space_available_1k=68283784, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26112, cpu_share=0.0, mem_res=19380, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20192, cpu_share=0.0, mem_res=14852, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0.0, mem_res=39524, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6965404, free=322408, buffers=436132, cached=8460264, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.93, five_min_avg=2.64, fifteen_min_avg=2.18, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:57:23.546 7fef8113fb70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:57:26.038 7fef8113fb70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:57:29.770 7fef812d24e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:58:06.145 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12821268, partition_space_available_1k=68269216, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27812, cpu_share=0.0, mem_res=20156, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20584, cpu_share=0.0, mem_res=14852, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51872, cpu_share=0.0, mem_res=39528, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6834336, free=493096, buffers=434696, cached=8422080, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.43, five_min_avg=3.66, fifteen_min_avg=2.56, cpu_share=11.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:59:06.157 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13192680, partition_space_available_1k=67897804, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27720, cpu_share=0.0, mem_res=20284, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20588, cpu_share=0.0, mem_res=14852, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51812, cpu_share=0.0, mem_res=39624, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6936612, free=279348, buffers=441756, cached=8526492, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.1, five_min_avg=3.66, fifteen_min_avg=2.63, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 01:59:28.919 7fef84a3d0f0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:59:31.898 7fef84a3d0f0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 01:59:57.389 7fef825b0a20 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:00:06.171 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13199144, partition_space_available_1k=67891340, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27940, cpu_share=0.0, mem_res=20396, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20684, cpu_share=0.0, mem_res=14984, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0.0, mem_res=39624, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6959392, free=331084, buffers=445368, cached=8448364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.58, five_min_avg=3.6, fifteen_min_avg=2.68, cpu_share=11.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 02:00:43.777 7fef849b2828 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:01:06.167 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13210320, partition_space_available_1k=67880164, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28136, cpu_share=0.0, mem_res=20516, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20804, cpu_share=0.0, mem_res=15116, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51836, cpu_share=0.0, mem_res=39720, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6942264, free=380384, buffers=444308, cached=8417252, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.18, five_min_avg=3.81, fifteen_min_avg=2.81, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 02:01:09.977 7fef81130d68 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:02:06.165 7fef84ca1048 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1199-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13214148, partition_space_available_1k=67876336, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28480, cpu_share=0.0, mem_res=21044, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20868, cpu_share=0.0, mem_res=15116, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28468, cpu_share=0.0, mem_res=25080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0.0, mem_res=39516, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6825336, free=501604, buffers=444448, cached=8412820, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.87, five_min_avg=3.53, fifteen_min_avg=2.78, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 04/28/2025 02:02:23.236 7fef82580588 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:02:25.758 7fef825b0438 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:02:29.511 7fef81146b70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 04/28/2025 02:02:37.963 7fef8267e6d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map