INFO: =================== Thu Sep 18 01:22:17 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/database-nodemgr/contrail-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.48 db_port=9042 db_jmx_port=7200 db_use_ssl=False [COLLECTOR] server_list=10.0.0.48:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 09/18/2025 01:22:18.182 7f09bd841680 [contrail-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 09/18/2025 01:22:18.282 7f09bd841680 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/18/2025 01:22:18.289 7f09bd841680 [contrail-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8103 09/18/2025 01:22:18.294 7f09bd841680 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/18/2025 01:22:18.301 7f09bd841680 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': '98379067e692b05800467173a47dd860b443de6ed96159f7a263e75c412f08bd', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 71206} ERROR:contrail-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 CRITICAL:root:Exit data: {'ID': 'd3fe42e11218e2321097103dbd9aaf7d523ee2908f194b4fdc2b0a47ad8e96ef', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 71225} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-18 01:24:05] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6748 0.001215 [Introspect:8103]10.0.0.48 - - [2025-09-18 01:24:18] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6748 0.001334 CRITICAL:root:Exit data: {'ID': 'b106f07c4ea638cb744e971838050e8a726378d70f142b2232c5d829b4e7d238', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 73218} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '0ff76fe173cbbff7c6efd42d3ce0089e92e5351a31ac25e450bed97a7ff21476', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 73237} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-18 01:24:30] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6715 0.001105 [Introspect:8103]10.0.0.48 - - [2025-09-18 01:24:33] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6715 0.000998 CRITICAL:root:Exit data: {'ID': '37ab108ba502bfa425fb3343a653bdeab711484fe9b7b9aa505c1ce0ba7bc690', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 75043} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '28d68a2ca01a05d1b406735af223b76ba45b9aa24bf459eff78cb3673bca6d65', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 75086} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'cc18c9ef2d93a8c724627ab114fe19a1101a0aadf15d0ea5b57fe6a6441728d3', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 77858} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'd118b227fc1aa941b8d253ff0804620f1409d6be44aac8a024c5d0c6be05b74c', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 77876} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '68be2132d8ab00d46a6f9ac5d75feeaf13ababdc81d21593bb2529024ec184a9', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 80976} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'bd1ba417b371bf00accbc0199b61a6db54fc24b6fc545b6588dd6ef8e41cc033', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 80995} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'dd64ff6973951f535ed9bd988132387c50375ac07f2fefb659faa99e33385163', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 82111} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '100c4686788edb0b40a69d909e4ccbcc3b98461b68b9059d3ec176315bc549ae', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 82132} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '26ac281440da094df13e63e5e8910dcfbe4ff935724f830bb0942de0bf6bd9be', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 83169} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '6533447222d999ec47dd0817632d9e2207d49085cce6a0751572c11556bfd780', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 83189} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'c9fa24e4aeddc52f8678a0e7130371fead15817feccdc5aaa75df842791baae1', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 85002} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '3761024a8a168bccd73b2b8a4eecedf845546dadc1431705d7ffb5bdcce89d6c', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 85024} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '559df15ec627c6662d5c427778863ceec776475e6af25c6eb27b5a2fe5aa7d36', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 87091} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '2a589b3802aadc41f458536f370afa3802262e49a2a9fa7568e3a52ede656176', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 87110} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-18 01:31:46] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6715 0.001615 CRITICAL:root:Exit data: {'ID': '9c9fffadb6d7980f88a42a2aeb5781c998b976c58059a50d9c971304dc1233dd', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 92684} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'c5426e8d9a14054d00d5918bfaa258823b427a2a8d396bac5b75a35af7df7885', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'a96a52b3fddfb0724c2f48c3e2a161985da794abd2ad6136ab8584ea82ed7759', 'DetachKeys': '', 'Pid': 92712} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes'