03/24/2025 01:51:35.834 7f4f340d1748 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/24/2025 01:51:35.835 7f4f340d1748 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/24/2025 01:51:35.835 7f4f340d1748 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/24/2025 01:51:35.845 7f4f355c30f0 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 03/24/2025 01:51:35.846 7f4f355c30f0 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 03/24/2025 01:51:35.847 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/24/2025 01:51:35.849 7f4f355c5a20 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:51:35.851 7f4f355c5a20 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 01:51:35.851 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/24/2025 01:51:35.852 7f4f355c5a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.333 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 54033092711321579455368650856311849635433002666368362652330939346530690835061, 'start': '1742781093000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 108731809926241833442811974619956385607288210513702786904139500622989860999492, 'start': '1742781093000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 12253383230634320773446073804514091153769333677492014607279607033748784864816, 'start': '1742781093000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 57591356631962690252421696394560562515972819236615167151066581437323005213129, 'start': '1742781093000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 87018842231873094427901756261260379271621184491510854952543778419174345026600, 'start': '1742781093000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/24/2025 01:51:36.540 7f4f340d1748 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1045-1', _node_type='Config', _instance_id='0', _timestamp=1742781096540054, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 01:51:36.541 7f4f340d1748 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1045-1', _node_type='Config', _instance_id='0', _timestamp=1742781096541042, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-24 00:45:24.984373", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8258-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 01:51:36.544 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.545 7f4f3a34ba20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-24 00:45:24.984373", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8258-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-24 00:45:24.984373", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8258-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/24/2025 01:51:36.546 7f4f3a34ba20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:39.849 7f4f30484828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:39.852 7f4f30484828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:39.852 7f4f30484828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:39.852 7f4f30484828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:39.853 7f4f30484828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:39.854 7f4f30484828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:39.854 7f4f30484828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:43.853 7f4f355df978 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:43.855 7f4f355df978 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:43.856 7f4f355df978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:44.467 7f4f355df978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:51:45.641 7f4f340d1748 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1045-1', _node_type='Config', _instance_id='0', _timestamp=1742781105641026, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1742781093000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-24 00:45:24.984373", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8258-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 03/24/2025 01:51:45.641 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10017592, partition_space_available_1k=71072892, percentage_partition_space_used=12, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3236, cpu_share=0, mem_res=764, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3324, cpu_share=0, mem_res=784, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3348, cpu_share=0, mem_res=632, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3236, cpu_share=0, mem_res=756, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0, mem_res=37860, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=3279196, free=2215968, buffers=432600, cached=10256440, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.58, five_min_avg=1.6, fifteen_min_avg=0.73, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:51:45.641 7f4f30464390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:45.641 7f4f30464390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1742781093000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-24 00:45:24.984373", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8258-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/24/2025 01:51:45.642 7f4f30464390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:45.642 7f4f30464390 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:45.642 7f4f30464390 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10017592 partition_space_available_1k = 71072892 percentage_partition_space_used = 12 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 3236 cpu_share = 0 mem_res = 764 >>contrail-schema : << mem_virt = 3324 cpu_share = 0 mem_res = 784 >>contrail-svc-monitor : << mem_virt = 3348 cpu_share = 0 mem_res = 632 >>contrail-device-manager : << mem_virt = 3236 cpu_share = 0 mem_res = 756 >>contrail-config-nodemgr : << mem_virt = 51856 cpu_share = 0 mem_res = 37860 >> } system_mem_usage = << total = 16184204 used = 3279196 free = 2215968 buffers = 432600 cached = 10256440 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.58 five_min_avg = 1.6 fifteen_min_avg = 0.73 cpu_share = 0 node_type = config-node >> >> 03/24/2025 01:51:45.642 7f4f30464390 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:47.855 7f4f30484048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:47.856 7f4f30484048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:47.857 7f4f30484048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:47.858 7f4f30484048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:47.858 7f4f30484048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:51.857 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:51.859 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:51.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:52.547 7f4f31837b70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:51:55.860 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:55.861 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:55.862 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:59.865 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:51:59.867 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:51:59.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:03.069 7f4f31837b70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:52:03.868 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:52:03.869 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 03/24/2025 01:52:03.870 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:52:03.870 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:03.870 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:52:03.870 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:03.871 7f4f31837b70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:52:03.872 7f4f31837b70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:07.870 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:52:07.871 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/24/2025 01:52:07.872 7f4f31cb0048 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/24/2025 01:52:07.873 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/24/2025 01:52:07.873 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 01:52:07.873 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 01:52:08.618 7f4f355b5a20 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connection Closed 03/24/2025 01:52:08.618 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/24/2025 01:52:08.618 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/24/2025 01:52:08.618 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:08.619 7f4f31cb0048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/24/2025 01:52:08.619 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:08.619 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:08.619 7f4f31cb0048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8100 start_time = 1742781095851231 collector_name = collector_ip = 10.0.0.37:8086 collector_list = [ 10.0.0.37:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 03/24/2025 01:52:08.619 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 01:52:12.623 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 01:52:12.624 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1045-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.37:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/24/2025 01:52:12.625 7f4f31cb0048 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/24/2025 01:52:12.627 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/24/2025 01:52:12.627 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 01:52:12.627 7f4f31cb0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 01:52:12.654 7f4f35592c18 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 03/24/2025 01:52:12.655 7f4f35592c18 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 01:52:12.655 7f4f31cb00f0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/24/2025 01:52:12.655 7f4f31cb00f0 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/24/2025 01:52:12.656 7f4f31cb00f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:52:12.656 7f4f31cb00f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 01:52:12.656 7f4f31cb00f0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/24/2025 01:52:12.656 7f4f31811cc0 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 01:52:12.657 7f4f31811cc0 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 01:52:32.073 7f4f35592c18 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001293 03/24/2025 01:52:32.075 7f4f35592c18 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 01:52:32.079 7f4f30469780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/24/2025 01:52:32.079 7f4f30469780 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 03/24/2025 01:52:32.079 7f4f30469780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:52:32.079 7f4f30469780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 01:52:32.409 7f4f30469780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:52:39.111 7f4f31cbfeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:52:45.593 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10602536, partition_space_available_1k=70487948, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=93956, cpu_share=1.75, mem_res=88012, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=78652, cpu_share=1.0, mem_res=73312, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84100, cpu_share=1.25, mem_res=78904, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183428, cpu_share=1.75, mem_res=162288, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51648, cpu_share=0.0, mem_res=38104, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6486448, free=217212, buffers=404708, cached=9075836, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.52, five_min_avg=3.5, fifteen_min_avg=1.42, cpu_share=22.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:53:45.593 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10626208, partition_space_available_1k=70464276, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97276, cpu_share=0.75, mem_res=90924, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81472, cpu_share=0.0, mem_res=75820, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90552, cpu_share=0.25, mem_res=84948, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197904, cpu_share=0.25, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51748, cpu_share=0.0, mem_res=38096, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6427088, free=376240, buffers=405724, cached=8975152, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.46, five_min_avg=4.11, fifteen_min_avg=1.78, cpu_share=15.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:54:45.617 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10630964, partition_space_available_1k=70459520, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97284, cpu_share=0.0, mem_res=90924, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81472, cpu_share=0.0, mem_res=75820, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90552, cpu_share=0.0, mem_res=84948, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197912, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51844, cpu_share=0.0, mem_res=37920, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6464484, free=331852, buffers=405796, cached=8982072, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.52, five_min_avg=3.8, fifteen_min_avg=1.81, cpu_share=9.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:55:45.632 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10635384, partition_space_available_1k=70455100, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97296, cpu_share=0.0, mem_res=90924, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81472, cpu_share=0.0, mem_res=75820, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90552, cpu_share=0.0, mem_res=84948, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197924, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0.0, mem_res=38020, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6475336, free=315104, buffers=405868, cached=8987896, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.74, five_min_avg=3.41, fifteen_min_avg=1.8, cpu_share=9.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:56:20.241 7f4f3045d780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:56:23.604 7f4f3045d780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:56:28.714 7f4f31cbf048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:56:45.648 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10640444, partition_space_available_1k=70450040, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97308, cpu_share=0.0, mem_res=90924, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81500, cpu_share=0.0, mem_res=75820, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90556, cpu_share=0.0, mem_res=84948, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197936, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52396, cpu_share=0.0, mem_res=38000, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6540400, free=234468, buffers=407400, cached=9001936, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.42, five_min_avg=3.42, fifteen_min_avg=1.9, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:57:19.056 7f4f31cb04e0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:57:45.659 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10653584, partition_space_available_1k=70436900, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98912, cpu_share=1.0, mem_res=91584, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82140, cpu_share=0.25, mem_res=76216, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91100, cpu_share=0.0, mem_res=85080, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197964, cpu_share=0.25, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52204, cpu_share=0.0, mem_res=37988, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6744808, free=221332, buffers=397676, cached=8820388, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.79, five_min_avg=3.99, fifteen_min_avg=2.19, cpu_share=14.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:57:49.428 7f4f3045f0f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:57:57.208 7f4f31ce1e10 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:58:00.475 7f4f33e0e390 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:58:03.925 7f4f33e0e390 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 01:58:45.648 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10664680, partition_space_available_1k=70425804, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100956, cpu_share=1.25, mem_res=92376, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82576, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91404, cpu_share=0.0, mem_res=85080, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197952, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52240, cpu_share=0.0, mem_res=38064, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6606184, free=443420, buffers=395180, cached=8739420, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.17, five_min_avg=3.59, fifteen_min_avg=2.16, cpu_share=10.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 01:59:45.662 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10670392, partition_space_available_1k=70420092, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101132, cpu_share=0.0, mem_res=92508, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82592, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91408, cpu_share=0.0, mem_res=85080, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197964, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52324, cpu_share=0.0, mem_res=38068, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6620116, free=422016, buffers=395212, cached=8746860, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.08, five_min_avg=3.18, fifteen_min_avg=2.11, cpu_share=8.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:00:45.676 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10675196, partition_space_available_1k=70415288, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101144, cpu_share=0.0, mem_res=92508, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82592, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91408, cpu_share=0.0, mem_res=85080, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197972, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52288, cpu_share=0.0, mem_res=37956, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6603740, free=431732, buffers=395300, cached=8753432, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=3.13, fifteen_min_avg=2.16, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:01:31.379 7f4f30484588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:01:34.653 7f4f30484588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:01:40.010 7f4f31cb0978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:01:45.019 7f4f3acef0f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:01:45.689 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10680708, partition_space_available_1k=70409776, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101156, cpu_share=0.0, mem_res=92508, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82600, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91408, cpu_share=0.0, mem_res=85080, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197984, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52352, cpu_share=0.0, mem_res=38072, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6722772, free=298284, buffers=395736, cached=8767412, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=2.98, fifteen_min_avg=2.17, cpu_share=10.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:02:45.675 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10688952, partition_space_available_1k=70401532, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101540, cpu_share=0.25, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198024, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52496, cpu_share=0.0, mem_res=37984, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6672280, free=323296, buffers=398544, cached=8790084, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.46, five_min_avg=3.48, fifteen_min_avg=2.39, cpu_share=11.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:03:45.680 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10694596, partition_space_available_1k=70395888, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101552, cpu_share=0.0, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198032, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52572, cpu_share=0.0, mem_res=38048, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6707640, free=281336, buffers=398584, cached=8796644, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.72, five_min_avg=3.15, fifteen_min_avg=2.35, cpu_share=8.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:04:45.699 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10707960, partition_space_available_1k=70382524, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101564, cpu_share=0.0, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198040, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52700, cpu_share=0.0, mem_res=38168, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6635220, free=347360, buffers=398596, cached=8803028, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.6, five_min_avg=3.01, fifteen_min_avg=2.35, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:05:32.900 7f4f3046cd68 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:05:45.697 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10713284, partition_space_available_1k=70377200, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101572, cpu_share=0.0, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198048, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52756, cpu_share=0.0, mem_res=38140, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6661096, free=314736, buffers=398640, cached=8809732, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.29, five_min_avg=2.84, fifteen_min_avg=2.33, cpu_share=9.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:06:01.111 7f4f30472e10 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:06:04.458 7f4f304840f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:06:09.395 7f4f31ce3b70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:06:45.706 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10718948, partition_space_available_1k=70371536, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101592, cpu_share=0.0, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198060, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52812, cpu_share=0.0, mem_res=38268, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6659816, free=306244, buffers=398720, cached=8819424, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.67, five_min_avg=2.85, fifteen_min_avg=2.37, cpu_share=10.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:07:45.719 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11830456, partition_space_available_1k=69260028, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101388, cpu_share=0.0, mem_res=92640, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82640, cpu_share=0.0, mem_res=76480, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91552, cpu_share=0.0, mem_res=85344, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196256, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52080, cpu_share=0.0, mem_res=38268, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6824584, free=343460, buffers=391780, cached=8624380, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.28, five_min_avg=3.25, fifteen_min_avg=2.53, cpu_share=16.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:08:45.699 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11843484, partition_space_available_1k=69247000, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103436, cpu_share=1.5, mem_res=93564, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83184, cpu_share=0.25, mem_res=76744, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91952, cpu_share=0.5, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196268, cpu_share=0.0, mem_res=175036, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51988, cpu_share=0.0, mem_res=38184, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6904756, free=246400, buffers=391928, cached=8641120, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.18, five_min_avg=3.93, fifteen_min_avg=2.83, cpu_share=11.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:09:45.708 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11861908, partition_space_available_1k=69228576, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107196, cpu_share=2.5, mem_res=94752, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84016, cpu_share=0.25, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92388, cpu_share=0.25, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196672, cpu_share=0.25, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51692, cpu_share=0.0, mem_res=38128, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6901080, free=275040, buffers=392104, cached=8615980, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.5, five_min_avg=4.0, fifteen_min_avg=2.92, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:10:35.263 7f4f31ce3e10 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:10:38.220 7f4f31cbfb70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:10:43.043 7f4f31cbf828 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:10:45.706 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11867952, partition_space_available_1k=69222532, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107164, cpu_share=0.0, mem_res=94752, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84012, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92384, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196524, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51564, cpu_share=0.0, mem_res=38176, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6914360, free=343180, buffers=392364, cached=8534300, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.95, five_min_avg=3.61, fifteen_min_avg=2.85, cpu_share=10.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:10:54.496 7f4f3412aeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:11:45.716 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11874260, partition_space_available_1k=69216224, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107384, cpu_share=0.0, mem_res=94752, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84008, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92376, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196540, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51576, cpu_share=0.0, mem_res=38396, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6910824, free=335688, buffers=392620, cached=8545072, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.19, five_min_avg=3.24, fifteen_min_avg=2.77, cpu_share=9.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:12:45.707 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11881572, partition_space_available_1k=69208912, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107476, cpu_share=0.0, mem_res=94752, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84048, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92460, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196636, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51648, cpu_share=0.0, mem_res=38088, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6988464, free=273924, buffers=397332, cached=8524484, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.14, five_min_avg=3.01, fifteen_min_avg=2.72, cpu_share=11.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:13:45.705 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11892660, partition_space_available_1k=69197824, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108888, cpu_share=1.5, mem_res=95148, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84512, cpu_share=0.25, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92880, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197008, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51700, cpu_share=0.0, mem_res=38144, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6752764, free=422772, buffers=403324, cached=8605344, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.85, five_min_avg=3.58, fifteen_min_avg=2.93, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:14:45.715 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12271748, partition_space_available_1k=68818736, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108584, cpu_share=0.0, mem_res=95148, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84488, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92856, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196440, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51428, cpu_share=0.0, mem_res=38044, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6921444, free=318684, buffers=410900, cached=8533176, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.48, five_min_avg=3.36, fifteen_min_avg=2.89, cpu_share=11.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:14:48.930 7f4f355b5eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:15:17.806 7f4f30484588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:15:45.734 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12279472, partition_space_available_1k=68811012, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109052, cpu_share=0.5, mem_res=95280, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84632, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=93016, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196552, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51412, cpu_share=0.0, mem_res=37940, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=7077616, free=235960, buffers=410792, cached=8459836, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.63, five_min_avg=3.89, fifteen_min_avg=3.11, cpu_share=12.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:15:46.628 7f4f355b5eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:15:52.552 7f4f355b5eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:15:56.020 7f4f3046c390 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:16:23.913 7f4f31cb02e8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:16:28.035 7f4f30484d68 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/24/2025 02:16:45.757 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12293448, partition_space_available_1k=68797036, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109360, cpu_share=0.25, mem_res=95280, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84660, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=93032, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196520, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51380, cpu_share=0.0, mem_res=38228, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6881668, free=407048, buffers=412248, cached=8483240, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.18, five_min_avg=4.19, fifteen_min_avg=3.27, cpu_share=11.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:17:45.755 7f4f340d1748 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1045-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12296608, partition_space_available_1k=68793876, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109836, cpu_share=0.5, mem_res=95280, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84832, cpu_share=0.0, mem_res=77140, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=93200, cpu_share=0.0, mem_res=85476, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196684, cpu_share=0.0, mem_res=175168, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51384, cpu_share=0.0, mem_res=38324, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6785880, free=468008, buffers=414252, cached=8516064, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.37, five_min_avg=3.82, fifteen_min_avg=3.19, cpu_share=11.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 03/24/2025 02:17:49.256 7f4f31ca90f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map