INFO: =================== Mon Oct 6 01:18:25 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/database-nodemgr/contrail-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.48 db_port=9042 db_jmx_port=7200 db_use_ssl=False [COLLECTOR] server_list=10.0.0.48:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 10/06/2025 01:18:27.042 7f417dbdf240 [contrail-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 10/06/2025 01:18:27.154 7f417dbdf240 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 10/06/2025 01:18:27.161 7f417dbdf240 [contrail-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8103 10/06/2025 01:18:27.166 7f417dbdf240 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 10/06/2025 01:18:27.172 7f417dbdf240 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': '1515f0423fc6f9a20f975d6d9285cfe9d2a8f16673267dad0b158037af98bcf7', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 71485} ERROR:contrail-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 CRITICAL:root:Exit data: {'ID': 'e714bd4252d9ebdeddba39ee472d2a7b187cc8880dc9838c45ddd461ec4473c3', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 71521} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-06 01:19:43] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6747 0.001288 [Introspect:8103]10.0.0.48 - - [2025-10-06 01:20:10] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6747 0.001684 [Introspect:8103]10.0.0.48 - - [2025-10-06 01:20:23] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6747 0.001004 CRITICAL:root:Exit data: {'ID': '7b5bf54b326a64378dcc9a46bf7aae12f481689d11d43cb5d70775628c7442ba', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 73770} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '032c423346418f5bf5d34fa4af1dab1d11790a7213ba113a79946f4ad9a1aabc', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 73803} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-06 01:20:36] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001192 [Introspect:8103]10.0.0.48 - - [2025-10-06 01:20:38] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001111 CRITICAL:root:Exit data: {'ID': '99cb828b86dd56f0ee13d76a3333d87bfb54336d1d3ae01beedd9265cee6ece5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 75571} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '4c17b579ff0b5fa7401e2c39caea8388aa209faf3b1bb6b07575c82cc5072827', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 75621} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '55d120ce793df32122e5959afde17e2ebd32a6ca75d012dfdafcf1590915ce7d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 78385} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'a45e8abc1fcba4681d320a92f3537de3837ac33a8c61235d69e4b5f342ac6a33', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 78425} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '43790a3df673ff4ce0d36ed796932b97bd4c32d2d980df5beb1c0e70a2a0a003', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 81475} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'e243bf5bb02a59d9e53f8300b9bf5c7a8d62510079a8ce64dfa99a5bad4a866e', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 81518} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '9b792d4e922994af5556bdada22643f92c075c33a4602864744d91bc2b7ef11d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 82639} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'ec012dde7fdcf407afd366feb7243818a013172238031209afef51be73447200', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 82664} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'd5cc85bdd78329cb551951d7d23a68400402ba92f1946aedadf75a5c2dee5dd1', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 83711} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '1def2cf7aa6115f3e320b6c34acfaa99240e72250f42c34db1a2a7e27f899ca0', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 83743} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '4389384b753f22ba43479d680dd7ff9a0e8ac65a000d17e0eb0ff227630da1c5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 84961} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '2b110eb01b6f6dedcf9375a760f592d0722993d0eb40523dd9ae857f7587a0d4', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 85114} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '23176f98ff86e9bdcf84304ece66d394d43fa1ce62b2ef2d20cee02af53ce1f3', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 87344} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '5d75027d31033b90b0b707cefd6ce540043502d7a3b8f7f1592f4a1919266bba', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 87469} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-06 01:28:01] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001141 CRITICAL:root:Exit data: {'ID': 'c403adf0765bbd1bb47fff193b03556d54e1d465440e82631bec55c8559b589c', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 92554} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'f04c44573163e11ce81431177f19127e16ef5808c1fe6488b8ae2385adca6435', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '944206a9eeecdcbcaedc48be7a237c3568483b2f70d1fefec128b9c0b4ec8858', 'DetachKeys': '', 'Pid': 92614} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes'