INFO: =================== Thu Sep 25 01:19:20 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/database-nodemgr/contrail-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.48 db_port=9042 db_jmx_port=7200 db_use_ssl=False [COLLECTOR] server_list=10.0.0.48:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 09/25/2025 01:19:22.044 7f6c45059040 [contrail-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 09/25/2025 01:19:22.149 7f6c45059040 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/25/2025 01:19:22.157 7f6c45059040 [contrail-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8103 09/25/2025 01:19:22.161 7f6c45059040 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/25/2025 01:19:22.166 7f6c45059040 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': 'a8e3de885ba73f9b90f6ea493eef58b76d4354ee9c2233fa66c68c65c503b077', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 71098} ERROR:contrail-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 CRITICAL:root:Exit data: {'ID': '1354939ae16c21206c45182211b63a4a342a3687b03cf43d2563117bc847cedb', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 71124} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-25 01:20:48] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6749 0.001200 [Introspect:8103]10.0.0.48 - - [2025-09-25 01:21:04] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6749 0.001169 [Introspect:8103]10.0.0.48 - - [2025-09-25 01:21:17] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6749 0.001006 CRITICAL:root:Exit data: {'ID': '4b635ccbf0779b62dc75fb39f4dc72b737e5e58940d935d4a1a4346befd87511', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 73386} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '64bf1c25337065b8a2c3bc683be51b4bc2e81eefc3945b5b41440b0186b641b5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 73405} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-25 01:21:29] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001118 [Introspect:8103]10.0.0.48 - - [2025-09-25 01:21:31] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001012 CRITICAL:root:Exit data: {'ID': '4bd8adc5fd3e430064c47fc493809575faf41f5e6d6222b8c76259e8d10fd99f', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 75942} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'a151381b909b7958e6b69d2eb3904d0ec9147dfb71e1f8fdc800f618163d3c55', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 75961} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '781cd90800536fa9a25aa74536c47624b41d4e09b559d10c25f47a8ba1d824b4', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 78009} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '51a01c718068d2936d881ff716a4ec59012f935fb5343ad13588c0bca8bb4f4d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 78028} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'a28b839ce8baf89537549580f7adb7f94591b33aa70e7a084b28a0e752bcfa12', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 81053} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'd14889954542a7712cee491197f55923141d280a462420adcc212e116f385256', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 81072} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '75d524dbfbcc3e56a3cf832f77768cdb28a5278ee6478e01968828c3dbf5e6af', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 82236} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'cfd943774a857aa18d60e3b40288c32e43bcd8558e0f38bceff45a2354e2b14d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 82254} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '4b6930a92c14eb27a6c71165d5bf178c63f621aec56f93960e29ebe57ed8e735', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 83326} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '41122ff8409ce0fa27ba3d6f71827dcae74c95b287a3835f2113e1d73b91e20e', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 83344} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'a056f28cb160025f21409170f64e776b21c53317bc225d5146a79b6572c750ba', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 85095} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '4d01102e65d1c90552f3db8bb6cf3a76af12bdbbe921200deeff1c6fc8be3788', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 85143} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'd90f047117ea755b6434b0098030e597a27200391fab424dce29c8fee9fdb5d4', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 87299} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '28f40f9d6f35789e9b34866477aba5172ce07cfe99ba34bac41b3c2745d58bc8', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '15da2965b1d6412c1e700c39b3c4d86bbe23920e63dbb07ad32e0ce4b2dabf0f', 'DetachKeys': '', 'Pid': 87318} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-25 01:28:45] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6717 0.001122