04/28/2025 01:42:21.804 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 04/28/2025 01:42:21.804 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 04/28/2025 01:42:21.804 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 04/28/2025 01:42:21.817 7fbe22af5048 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 04/28/2025 01:42:21.818 7fbe22af5048 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 04/28/2025 01:42:21.820 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 04/28/2025 01:42:21.821 7fbe22afc978 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:21.822 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:21.823 7fbe22afc978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 04/28/2025 01:42:21.823 7fbe22afc978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.212 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 82155427104387078280236805236400601557866811560367242333522342832945302737956, 'start': '1745804538000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 55661204202734311498966165520792538048415944225587003971870305943940171687113, 'start': '1745804538000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 17443285926219014399115941999847244077620230020455891621626866093023434708029, 'start': '1745804538000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 41816143111237102972699805353525332070803835263649966939648928730566072336341, 'start': '1745804538000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 88333856984650202047783984724263616045825080626950991018984246943072106966398, 'start': '1745804538000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 04/28/2025 01:42:22.517 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-532-1', _node_type='Config', _instance_id='0', _timestamp=1745804542517281, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/28/2025 01:42:22.518 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-532-1', _node_type='Config', _instance_id='0', _timestamp=1745804542517940, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/28/2025 01:42:22.521 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:22.522 7fbe256ed8d0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/28/2025 01:42:22.523 7fbe256ed8d0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:25.822 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:25.823 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:25.824 7fbe25a24438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:27.569 7fbe25a24438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:42:29.824 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:29.825 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:29.826 7fbe236c3c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:31.595 7fbe25b17a48 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-532-1', _node_type='Config', _instance_id='0', _timestamp=1745804551595859, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1745804538000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 04/28/2025 01:42:31.596 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=50509996, partition_space_available_1k=30580488, percentage_partition_space_used=62, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=6472, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1584, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1592, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1644, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=78124, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11946780, free=432028, buffers=870516, cached=19415796, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.27, five_min_avg=3.65, fifteen_min_avg=2.58, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:42:31.596 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:31.597 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1745804538000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-04-28 00:40:37.306388", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9012-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 04/28/2025 01:42:31.597 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:31.597 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:31.597 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 50509996 partition_space_available_1k = 30580488 percentage_partition_space_used = 62 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 6472 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 1584 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 1592 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 1644 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 78124 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 11946780 free = 432028 buffers = 870516 cached = 19415796 node_type = config-node >> system_cpu_usage = << one_min_avg = 6.27 five_min_avg = 3.65 fifteen_min_avg = 2.58 cpu_share = 0 node_type = config-node >> >> 04/28/2025 01:42:31.597 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:33.827 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:33.828 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:33.828 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:33.829 7fbe270a2780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:33.830 7fbe270a2780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:37.829 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:37.831 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:37.831 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:37.832 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:37.833 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:37.833 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:37.833 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:37.833 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:38.232 7fbe23de9828 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:42:41.834 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:41.835 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:41.836 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:41.837 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:41.837 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:41.837 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:41.837 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:45.840 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:45.841 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:45.841 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:45.841 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:45.841 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:45.842 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:45.842 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:45.842 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:45.851 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:47.888 7fbe23de9828 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:42:49.842 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:49.843 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:49.843 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:49.843 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:49.844 7fbe23de9828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:49.845 7fbe23de9828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:53.844 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:42:58.848 7fbe232d3588 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 04/28/2025 01:42:58.848 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:42:58.848 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:58.848 7fbe232d3588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-532-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1745804541822003 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 04/28/2025 01:42:58.849 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 04/28/2025 01:43:02.852 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-532-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 04/28/2025 01:43:06.027 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 04/28/2025 01:43:06.028 7fbe232d3588 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 04/28/2025 01:43:06.028 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 04/28/2025 01:43:06.028 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/28/2025 01:43:06.028 7fbe232d3588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 04/28/2025 01:43:06.098 7fbe236c6d68 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001011 04/28/2025 01:43:06.098 7fbe236c6d68 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/28/2025 01:43:06.099 7fbe2556eeb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 04/28/2025 01:43:06.099 7fbe2556eeb8 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 04/28/2025 01:43:06.099 7fbe2556eeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:06.099 7fbe2556eeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:43:06.099 7fbe2556eeb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 04/28/2025 01:43:06.100 7fbe25a0e2e8 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 04/28/2025 01:43:06.101 7fbe25a0e2e8 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 04/28/2025 01:43:07.008 7fbe2556eeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:15.593 7fbe23309a20 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:15.997 7fbe236c6d68 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001291 04/28/2025 01:43:15.998 7fbe236c6d68 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 04/28/2025 01:43:15.998 7fbe25b82240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 04/28/2025 01:43:15.998 7fbe25b82240 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 04/28/2025 01:43:15.998 7fbe25b82240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:15.998 7fbe25b82240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 04/28/2025 01:43:23.704 7fbe25b6aeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:28.467 7fbe23309cc0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:31.597 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51142144, partition_space_available_1k=29948340, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97144, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=77840, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79480, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170096, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56648, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=14931304, free=11687992, buffers=839492, cached=5206332, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.52, five_min_avg=4.79, fifteen_min_avg=3.04, cpu_share=8.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:43:32.492 7fbe254772e8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:52.375 7fbe270a20f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:43:58.339 7fbe232d3630 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:44:04.372 7fbe23de9828 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:44:31.593 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51176812, partition_space_available_1k=29913672, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107872, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82684, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89836, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=191148, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56652, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15050288, free=11418904, buffers=847388, cached=5348540, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.29, five_min_avg=4.93, fifteen_min_avg=3.2, cpu_share=6.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:45:31.603 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51185948, partition_space_available_1k=29904536, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108704, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82764, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89884, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192232, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56656, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15077136, free=11307372, buffers=848748, cached=5431864, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.55, five_min_avg=4.78, fifteen_min_avg=3.26, cpu_share=3.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:46:30.784 7fbe232c6c18 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:46:31.618 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51164440, partition_space_available_1k=29926044, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108720, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82764, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89884, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192264, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56656, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15332440, free=10998644, buffers=849044, cached=5484992, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.47, five_min_avg=4.62, fifteen_min_avg=3.29, cpu_share=3.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:47:31.645 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51751988, partition_space_available_1k=29338496, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108764, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82768, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89880, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192256, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56996, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15141644, free=8615680, buffers=899680, cached=8008116, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.81, five_min_avg=5.43, fifteen_min_avg=3.67, cpu_share=6.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:48:22.548 7fbe236c6f60 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:48:31.630 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52215840, partition_space_available_1k=28874644, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109444, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83132, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89948, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192328, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57216, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15759932, free=8072984, buffers=903088, cached=7929116, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.82, five_min_avg=4.83, fifteen_min_avg=3.57, cpu_share=4.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:49:26.657 7fbe232d3198 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:49:31.654 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52257440, partition_space_available_1k=28833044, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=112860, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83388, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90056, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192444, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57240, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=17075936, free=6668004, buffers=906608, cached=8014572, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.18, five_min_avg=5.15, fifteen_min_avg=3.75, cpu_share=5.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:49:31.985 7fbe254772e8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:49:58.923 7fbe236c3630 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:50:31.655 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52283324, partition_space_available_1k=28807160, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=117124, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83780, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90416, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192820, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57248, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=16646012, free=7066404, buffers=906712, cached=8045992, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.3, five_min_avg=5.66, fifteen_min_avg=4.01, cpu_share=5.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:50:37.180 7fbe258b9ac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:51:31.669 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52319964, partition_space_available_1k=28770520, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120688, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84328, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90892, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193272, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57284, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=16663120, free=7023548, buffers=907180, cached=8071272, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.25, five_min_avg=5.33, fifteen_min_avg=4.0, cpu_share=4.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:52:31.695 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52405912, partition_space_available_1k=28684572, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122232, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84540, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91028, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193404, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57280, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=17764844, free=5858736, buffers=907224, cached=8134316, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.7, five_min_avg=6.2, fifteen_min_avg=4.39, cpu_share=7.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:53:31.691 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52396068, partition_space_available_1k=28694416, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125116, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85020, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91292, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193668, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57284, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=17111684, free=6488060, buffers=907252, cached=8158124, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.89, five_min_avg=5.68, fifteen_min_avg=4.33, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:54:31.698 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52411156, partition_space_available_1k=28679328, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127384, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85192, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91428, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193812, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57284, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=16844636, free=6742032, buffers=907264, cached=8171188, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.04, five_min_avg=5.26, fifteen_min_avg=4.27, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:54:43.232 7fbe22b0d978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:54:49.012 7fbe236c3048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:54:54.153 7fbe22aaa780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:55:00.332 7fbe232cc588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:55:31.703 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52425972, partition_space_available_1k=28664512, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129496, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85432, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91636, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194044, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57296, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=16892128, free=6667692, buffers=907292, cached=8198008, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.98, five_min_avg=5.4, fifteen_min_avg=4.38, cpu_share=4.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:56:25.608 7fbe23309d68 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 04/28/2025 01:56:31.702 7fbe25b17a48 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-532-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52434480, partition_space_available_1k=28656004, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=130144, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85568, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=91744, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194160, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57292, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=16666248, free=6880680, buffers=907296, cached=8210896, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.27, five_min_avg=5.13, fifteen_min_avg=4.35, cpu_share=5.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 04/28/2025 01:57:24.312 7fbe25a0cac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map