INFO: =================== Mon Sep 22 01:31:51 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/config-database-nodemgr/contrail-config-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.50 db_port=9041 db_jmx_port=7201 db_use_ssl=False [COLLECTOR] server_list=10.0.0.50:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 09/22/2025 01:31:53.392 7f5467730f40 [contrail-config-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 09/22/2025 01:31:53.558 7f5467730f40 [contrail-config-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/22/2025 01:31:53.566 7f5467730f40 [contrail-config-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8112 09/22/2025 01:31:53.570 7f5467730f40 [contrail-config-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/22/2025 01:31:53.576 7f5467730f40 [contrail-config-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': '668d847c9fcb67e1fb48ee3f0269655935e380640af86dc5e5e11d139b301650', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 67811} ERROR:contrail-config-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down >>, ] >> CRITICAL:root:Exit data: {'ID': '84c75ef428d1a363259514d9164c43d4f1bc8d78513859b3c50210bf9142507f', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 67830} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 CRITICAL:root:Exit data: {'ID': '0a1fc2acb4de576ac233e7a62e457cca2db800a593aa80aa9f77f28385f5e791', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'config_db_uuid'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 67939} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr config_db_uuid'. Error is: Result: 1 ERROR:contrail-config-database-nodemgr:Session Event: TCP Connect Fail ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1758504713590899 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> CRITICAL:root:Exit data: {'ID': '6795fbc2bbcf5cc8df76dfe486975c379f3224fa92b808d62fcf85e7630e3408', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'to_bgp_keyspace'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 68117} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr to_bgp_keyspace'. Error is: Result: 1 CRITICAL:root:Exit data: {'ID': '43b761701228de78fe32d2fea64d06ba0101cf11d78e2a40f8478719942cd3aa', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'svc_monitor_keyspace'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 68238} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr svc_monitor_keyspace'. Error is: Result: 1 CRITICAL:root:Exit data: {'ID': '2813e428b39f4bfaa839e80d185c3d13d483303fc3881aa7fd8b821a1556bd0c', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'DISCOVERY_SERVER'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 68346} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr DISCOVERY_SERVER'. Error is: Result: 1 CRITICAL:root:Exit data: {'ID': '038866b9ccaa871d6ce035c9e50417d6f163a414e4414791e090632536bf934d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'useragent'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 68443} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr useragent'. Error is: Result: 1 ERROR:contrail-config-database-nodemgr:Session Event: TCP Connect Fail ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1758504713590899 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> CRITICAL:root:Exit data: {'ID': 'd202fba60fcff9fea0ef8c488ac3d0bacc7101af7a9e5e6a64336028274ef12d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'repair', '-pr', 'dm_keyspace'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 68526} ERROR:contrail-config-database-nodemgr:Failed to run cmd: 'nodetool -p 7201 repair -pr dm_keyspace'. Error is: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' ERROR:contrail-config-database-nodemgr:Session Event: TCP Connect Fail ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1758504713590899 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local disk_usage_info = { /dev/vda4 : << partition_type = xfs partition_space_used_1k = 12025372 partition_space_available_1k = 70665680 percentage_partition_space_used = 15 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1271088 cpu_share = 0.0 mem_res = 1259740 >>zookeeper : << mem_virt = 63548 cpu_share = 0.0 mem_res = 60988 >>contrail-config-database-nodemgr : << mem_virt = 50900 cpu_share = 0.0 mem_res = 42636 >> } system_mem_usage = << total = 16111716 used = 5859800 free = 202064 buffers = 3928 cached = 10045924 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 4.88 five_min_avg = 1.79 fifteen_min_avg = 0.68 cpu_share = 0 node_type = config-database-node >> >> ERROR:contrail-config-database-nodemgr:SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-254-1.cluster.local process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> CRITICAL:root:Exit data: {'ID': '9b1eb7aa90f707c2ae2af0b1d417c61ab612b0c940616106d8726201fd77dbee', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 74464} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'f3dcfc499e496775271d30f3897dfe37a254fe5b7fd124c4fd207766bdf72698', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 74483} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8112]10.0.0.50 - - [2025-09-22 01:33:38] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6735 0.001984 [Introspect:8112]10.0.0.50 - - [2025-09-22 01:33:40] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6735 0.002572 CRITICAL:root:Exit data: {'ID': 'b4a7465f18051f5648bc4e0fcad694d3ed7cbefb47f295167e6fb80d8a76dcb7', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 76281} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '279af73f711ceff6bb8e5097376a87a76733adf038241f842573b25241e60c89', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 76300} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '51cc7c440615650f1089fc4023781bd51bc3fc43c60349a8d6aa70d010ca048d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 78887} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '0a44f37b5b4c575affd8c0632218735d78167690d86366f12532a0dc8a027cc4', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 78918} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '05c20a70b6dc3f5c372f3ae867e7245d4722c3c17f50d105f31bb153ffbbe1dc', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 80688} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '53353d71a8d73f7b5c17d66d353eece9ea6a9a72db199755aa42d885ca477244', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 80708} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'e81f5f4e0f0af3cb01781828cf2317300fbd0b2a1ade8622610eba0462221cd0', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 83508} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'ab101c2c4f38a84397a5cebbb538537773f52bece228a16220912075018a16f2', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 83527} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'b44726bae3811e4d3767d8a625e2151a788c2bd8f70c4df786652b929c00bd51', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 84620} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'd22b3aef6bdf6d747737c57d5fb4262602851080b4a6d15ecb616165f7153767', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 84638} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'c95ed9a9512885302985d2f940fbe05ad6fc8a676fb60f459461862eb31e9b16', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 85694} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'd664daab0474e514fcd2dc0c61061c9ce3457a129bd46aef469b56441a06d307', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 85712} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '8bdaa2ad2e961d1df5eb919ed4a94217c11ee31356c4752c573535a2e9f7f5ff', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 87470} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '94f782ba39bebe5f4f0f76d18eac88120fa76c9a17e3f42ea2a10c7bc4af86f5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 87489} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '9a04763210a4d425ef7f8bfc8dca4a6b491600547ff2a4540552888f2af3d715', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.50', '9041', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 89745} WARNING:contrail-config-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '482b2846aaef84a0db0d27f460a3e1e9a46ff1a02e0ec259343601a5975326ec', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7201', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'd8cc249f977252215996577ed4d78e62a51f4158f2792b4a27e7b90a9f78f8bf', 'DetachKeys': '', 'Pid': 89763} ERROR:contrail-config-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-config-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8112]10.0.0.50 - - [2025-09-22 01:41:17] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6735 0.001382