08/22/2024 01:52:00.891 7f9da8027af8 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/22/2024 01:52:00.892 7f9da8027af8 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/22/2024 01:52:00.892 7f9da8027af8 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/22/2024 01:52:00.899 7f9da26ef748 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 08/22/2024 01:52:00.899 7f9da26ef748 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 08/22/2024 01:52:00.900 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 08/22/2024 01:52:00.900 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/22/2024 01:52:00.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.266 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 34154970494761032674553166925102376619732254449541240490169477591288823456380, 'start': '1724291518000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 1218595289486657799408099964563994568162481262862172010038946444257566690713, 'start': '1724291518000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 19784259512412781203724123316933087198909934546839861678588406276267348493161, 'start': '1724291519000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 88318206706965743712137580462466246046508233605844630307385053349347009115353, 'start': '1724291519000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 105631873013571355595352404230536722132984820810122142614430514495111377549961, 'start': '1724291519000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 08/22/2024 01:52:02.447 7f9da8027af8 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-578-1', _node_type='Config', _instance_id='0', _timestamp=1724291522447536, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/22/2024 01:52:02.448 7f9da8027af8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-578-1', _node_type='Config', _instance_id='0', _timestamp=1724291522448230, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291518000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291518000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-08-22 01:04:49.815492", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-4706-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/22/2024 01:52:02.451 7f9da2707248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-08-22 01:04:49.815492", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-4706-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:02.452 7f9da2707248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291518000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291518000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-08-22 01:04:49.815492", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-4706-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 08/22/2024 01:52:02.453 7f9da2707248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:04.901 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:04.902 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:04.902 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:04.902 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:04.902 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:04.902 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:04.903 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:04.903 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:04.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:04.905 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:04.906 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:04.909 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:04.909 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:04.909 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:08.903 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:08.904 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:08.904 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:08.904 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:08.905 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:11.559 7f9da8027af8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-578-1', _node_type='Config', _instance_id='0', _timestamp=1724291531559398, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291518000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291518000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1724291519000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-08-22 01:04:49.815492", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-4706-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/22/2024 01:52:11.559 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10686544, partition_space_available_1k=70403940, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3236, cpu_share=0, mem_res=932, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3396, cpu_share=0, mem_res=676, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3220, cpu_share=0, mem_res=564, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3484, cpu_share=0, mem_res=732, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53100, cpu_share=0, mem_res=40212, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=2793408, free=1990816, buffers=441644, cached=10958340, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.07, five_min_avg=1.44, fifteen_min_avg=0.7, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291518000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291518000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1724291519000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-08-22 01:04:49.815492", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-4706-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10686544 partition_space_available_1k = 70403940 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 3236 cpu_share = 0 mem_res = 932 >>contrail-schema : << mem_virt = 3396 cpu_share = 0 mem_res = 676 >>contrail-svc-monitor : << mem_virt = 3220 cpu_share = 0 mem_res = 564 >>contrail-device-manager : << mem_virt = 3484 cpu_share = 0 mem_res = 732 >>contrail-config-nodemgr : << mem_virt = 53100 cpu_share = 0 mem_res = 40212 >> } system_mem_usage = << total = 16184208 used = 2793408 free = 1990816 buffers = 441644 cached = 10958340 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.07 five_min_avg = 1.44 fifteen_min_avg = 0.7 cpu_share = 0 node_type = config-node >> >> 08/22/2024 01:52:11.560 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:12.906 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:12.907 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:12.907 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:12.907 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:12.908 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:12.909 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:12.909 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:13.528 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:52:16.909 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:16.910 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:16.911 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:20.913 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:20.914 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:20.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:24.875 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:52:24.915 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:24.916 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:24.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:28.917 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:28.918 7f9da2648048 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/22/2024 01:52:28.918 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:28.918 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:28.918 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1724291520901007 collector_name = collector_ip = 10.0.0.31:8086 collector_list = [ 10.0.0.31:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/22/2024 01:52:28.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/22/2024 01:52:32.919 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-578-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.31:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/22/2024 01:52:32.921 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 08/22/2024 01:52:32.922 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/22/2024 01:52:32.922 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/22/2024 01:52:32.922 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/22/2024 01:52:32.925 7f9da2707248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001012 08/22/2024 01:52:32.926 7f9da2707248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/22/2024 01:52:32.926 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/22/2024 01:52:32.926 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 08/22/2024 01:52:32.926 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:52:32.926 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/22/2024 01:52:32.926 7f9da2648048 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/22/2024 01:52:32.927 7f9da2648148 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/22/2024 01:52:32.928 7f9da2648148 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/22/2024 01:52:56.046 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:53:11.493 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11113580, partition_space_available_1k=69976904, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96384, cpu_share=1.5, mem_res=87580, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70028, cpu_share=0.5, mem_res=64356, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72944, cpu_share=0.75, mem_res=67156, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173364, cpu_share=1.0, mem_res=159596, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53548, cpu_share=0.0, mem_res=40944, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=5902492, free=241876, buffers=399680, cached=9640160, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.04, five_min_avg=2.72, fifteen_min_avg=1.18, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:53:14.131 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:53:24.854 7f9da2707248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001292 08/22/2024 01:53:24.858 7f9da2707248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/22/2024 01:53:24.859 7f9da2648048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/22/2024 01:53:24.859 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 08/22/2024 01:53:24.859 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:53:24.859 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/22/2024 01:54:11.512 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11159752, partition_space_available_1k=69930732, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101084, cpu_share=2.5, mem_res=90748, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71588, cpu_share=0.25, mem_res=65544, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82284, cpu_share=0.25, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174852, cpu_share=0.75, mem_res=161180, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53592, cpu_share=0.0, mem_res=41068, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6367772, free=205260, buffers=400076, cached=9211100, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.05, five_min_avg=4.23, fifteen_min_avg=1.81, cpu_share=17.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:55:11.519 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11173528, partition_space_available_1k=69916956, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101084, cpu_share=0.0, mem_res=90748, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71588, cpu_share=0.0, mem_res=65544, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82296, cpu_share=0.0, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174880, cpu_share=0.0, mem_res=161180, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53624, cpu_share=0.0, mem_res=41052, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6328156, free=244752, buffers=405620, cached=9205680, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.18, five_min_avg=4.02, fifteen_min_avg=1.89, cpu_share=10.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:55:19.337 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:55:23.345 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:55:46.320 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:11.523 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11180908, partition_space_available_1k=69909576, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101088, cpu_share=0.0, mem_res=90748, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71600, cpu_share=0.0, mem_res=65544, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82300, cpu_share=0.0, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174836, cpu_share=0.0, mem_res=161180, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53692, cpu_share=0.0, mem_res=41012, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6480744, free=222700, buffers=399728, cached=9081036, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.28, five_min_avg=3.94, fifteen_min_avg=1.99, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:56:20.677 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:27.765 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:33.672 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:43.023 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:48.730 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:52.952 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:56:57.490 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:57:11.548 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11187828, partition_space_available_1k=69902656, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101208, cpu_share=0.0, mem_res=90880, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71608, cpu_share=0.0, mem_res=65544, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82304, cpu_share=0.0, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174828, cpu_share=0.0, mem_res=161180, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53752, cpu_share=0.0, mem_res=41344, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6425000, free=308344, buffers=400560, cached=9050304, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.58, five_min_avg=3.84, fifteen_min_avg=2.08, cpu_share=10.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:57:19.559 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:57:24.693 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:57:32.471 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:57:37.744 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:57:43.689 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 01:58:11.546 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11204468, partition_space_available_1k=69886016, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104308, cpu_share=1.5, mem_res=92860, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72836, cpu_share=0.25, mem_res=66204, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82884, cpu_share=0.25, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175488, cpu_share=0.25, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53884, cpu_share=0.0, mem_res=41208, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6550576, free=228704, buffers=399436, cached=9005492, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.62, five_min_avg=3.83, fifteen_min_avg=2.19, cpu_share=13.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 01:59:11.544 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11209660, partition_space_available_1k=69880824, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104492, cpu_share=0.0, mem_res=92992, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72964, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82892, cpu_share=0.0, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175468, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54128, cpu_share=0.0, mem_res=41096, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6610212, free=201088, buffers=399768, cached=8973140, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.8, five_min_avg=3.57, fifteen_min_avg=2.2, cpu_share=9.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:00:11.562 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11214332, partition_space_available_1k=69876152, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104512, cpu_share=0.0, mem_res=93124, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72964, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82892, cpu_share=0.0, mem_res=75892, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175468, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54148, cpu_share=0.0, mem_res=41172, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6603308, free=201960, buffers=399964, cached=8978976, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.27, five_min_avg=3.24, fifteen_min_avg=2.18, cpu_share=8.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:00:34.115 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:00:38.169 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:00:43.351 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:01:11.562 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11218456, partition_space_available_1k=69872028, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104516, cpu_share=0.0, mem_res=93124, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72964, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82892, cpu_share=0.0, mem_res=76024, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175464, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54092, cpu_share=0.0, mem_res=41160, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6572472, free=237456, buffers=399700, cached=8974580, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.75, five_min_avg=2.91, fifteen_min_avg=2.13, cpu_share=8.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:02:11.573 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11222924, partition_space_available_1k=69867560, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104548, cpu_share=0.0, mem_res=93124, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72976, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82956, cpu_share=0.0, mem_res=76024, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175476, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54168, cpu_share=0.0, mem_res=41272, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6546136, free=257176, buffers=399880, cached=8981016, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.3, five_min_avg=2.57, fifteen_min_avg=2.06, cpu_share=7.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:02:21.185 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:03:11.568 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11227500, partition_space_available_1k=69862984, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104540, cpu_share=0.0, mem_res=93124, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72976, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82956, cpu_share=0.0, mem_res=76024, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175452, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54088, cpu_share=0.0, mem_res=41320, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6578588, free=277084, buffers=397132, cached=8931404, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.33, five_min_avg=2.67, fifteen_min_avg=2.13, cpu_share=7.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:04:11.572 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11233920, partition_space_available_1k=69856564, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104596, cpu_share=0.0, mem_res=93256, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72992, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83008, cpu_share=0.0, mem_res=76024, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175472, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54112, cpu_share=0.0, mem_res=41272, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6597040, free=245276, buffers=398720, cached=8943172, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.58, five_min_avg=2.7, fifteen_min_avg=2.17, cpu_share=10.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:05:11.579 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12621824, partition_space_available_1k=68468660, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104344, cpu_share=0.0, mem_res=93256, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72992, cpu_share=0.0, mem_res=66336, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83012, cpu_share=0.0, mem_res=76024, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174956, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53928, cpu_share=0.0, mem_res=41296, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6666316, free=310480, buffers=413136, cached=8794276, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.71, five_min_avg=2.71, fifteen_min_avg=2.21, cpu_share=13.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:05:41.000 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:05:44.755 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:05:48.908 7f9da2648148 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:06:11.580 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12635188, partition_space_available_1k=68455296, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105656, cpu_share=0.75, mem_res=94312, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73440, cpu_share=0.0, mem_res=66600, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83464, cpu_share=0.25, mem_res=76288, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175056, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53976, cpu_share=0.0, mem_res=41312, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6832540, free=223368, buffers=417676, cached=8710624, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.86, five_min_avg=2.85, fifteen_min_avg=2.29, cpu_share=10.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:06:46.385 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:07:11.596 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12641292, partition_space_available_1k=68449192, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=106068, cpu_share=0.25, mem_res=94576, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73564, cpu_share=0.0, mem_res=66600, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83620, cpu_share=0.0, mem_res=76288, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175156, cpu_share=0.0, mem_res=161444, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54036, cpu_share=0.0, mem_res=41508, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6829100, free=217304, buffers=417980, cached=8719824, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=2.72, fifteen_min_avg=2.28, cpu_share=9.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:08:11.582 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12654072, partition_space_available_1k=68436412, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107996, cpu_share=1.5, mem_res=95764, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74280, cpu_share=0.25, mem_res=66996, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84020, cpu_share=0.0, mem_res=76420, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175540, cpu_share=0.0, mem_res=161576, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53864, cpu_share=0.0, mem_res=41444, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6863532, free=209444, buffers=417888, cached=8693344, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.93, five_min_avg=2.86, fifteen_min_avg=2.36, cpu_share=10.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:09:11.592 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12659832, partition_space_available_1k=68430652, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108448, cpu_share=0.25, mem_res=95896, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74520, cpu_share=0.0, mem_res=66996, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84232, cpu_share=0.0, mem_res=76552, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175688, cpu_share=0.0, mem_res=161576, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53800, cpu_share=0.0, mem_res=41376, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6872092, free=215600, buffers=417968, cached=8678548, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.05, five_min_avg=3.04, fifteen_min_avg=2.44, cpu_share=9.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:10:11.582 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12667632, partition_space_available_1k=68422852, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108524, cpu_share=0.25, mem_res=96028, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74544, cpu_share=0.0, mem_res=66996, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84260, cpu_share=0.0, mem_res=76552, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175680, cpu_share=0.0, mem_res=161576, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53792, cpu_share=0.0, mem_res=41408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6871236, free=230784, buffers=428000, cached=8654188, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.84, five_min_avg=2.88, fifteen_min_avg=2.42, cpu_share=9.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:10:18.869 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:10:23.692 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:10:27.774 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:11:11.585 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12672368, partition_space_available_1k=68418116, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108608, cpu_share=0.0, mem_res=96028, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74644, cpu_share=0.0, mem_res=66996, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84376, cpu_share=0.0, mem_res=76552, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175828, cpu_share=0.0, mem_res=161576, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53824, cpu_share=0.0, mem_res=41404, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6869724, free=244336, buffers=428356, cached=8641792, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.33, five_min_avg=2.93, fifteen_min_avg=2.47, cpu_share=9.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:12:11.595 7f9da8027af8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-578-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12686816, partition_space_available_1k=68403668, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=110368, cpu_share=1.5, mem_res=96952, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75116, cpu_share=0.25, mem_res=66996, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84732, cpu_share=0.0, mem_res=76552, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=176192, cpu_share=0.0, mem_res=161576, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53880, cpu_share=0.0, mem_res=41500, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=6774300, free=310300, buffers=428460, cached=8671148, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.27, five_min_avg=2.68, fifteen_min_avg=2.41, cpu_share=10.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/22/2024 02:12:25.205 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/22/2024 02:12:47.628 7f9da2648048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map