INFO: =================== Thu Oct 2 01:20:24 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/database-nodemgr/contrail-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.48 db_port=9042 db_jmx_port=7200 db_use_ssl=False [COLLECTOR] server_list=10.0.0.48:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 10/02/2025 01:20:25.383 7fb1b57dea00 [contrail-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 10/02/2025 01:20:25.508 7fb1b57dea00 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 10/02/2025 01:20:25.515 7fb1b57dea00 [contrail-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8103 10/02/2025 01:20:25.518 7fb1b57dea00 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 10/02/2025 01:20:25.525 7fb1b57dea00 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': 'af7b72d47bb10d3ec52d8cf11530a5a9d06e8abdb37d258409a3e696b5ebcd02', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 71224} ERROR:contrail-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 CRITICAL:root:Exit data: {'ID': '80af5ce8b775839dc68ac48b83488466b6970e743569ade73440bbea56e0a9b1', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 71248} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-02 01:21:55] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6746 0.002398 [Introspect:8103]10.0.0.48 - - [2025-10-02 01:22:08] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6746 0.001331 [Introspect:8103]10.0.0.48 - - [2025-10-02 01:22:21] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6746 0.001039 CRITICAL:root:Exit data: {'ID': 'ef8bad580c14ff59c0746029069785120ee039ecf9e208ccae0b25f4b093d7bb', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 73534} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'ddd2b19d951f75c8fa95ca5a1255f2fe5563431d13f2f77487c19b4bee4724d6', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 73554} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-02 01:22:33] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6715 0.003268 [Introspect:8103]10.0.0.48 - - [2025-10-02 01:22:36] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6715 0.000939 CRITICAL:root:Exit data: {'ID': 'feb0285917d80d556a0170661e034edb0e44c2645e569b5d27b9004c7756d530', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 75319} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'beeb9d736bf13acd20f675a7be6435d18b395dd1300ef2ff23be72dc0c351a89', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 75342} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '707f66b3785c1a44a19b3125ca01ba9119c9cc88f1daaaa4831348a4e4914639', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 78032} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '2e38e76d10aedfe6af636a5b2035edc677a8cfbcccaccc85fcade1433f5a1b71', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 78051} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'b0e1591a5187044c2ed124e7491db10b70879ff876e87aa7c1aa77e86ab11484', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 80780} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '22becee1ceaff1b3ffb79bf5735db07660cbbef83dd5b198fbd6c64684c81514', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 80798} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '135893114b63a54ae1290cbe2718ab4305f9d7a4dbbe1371eb2083654766d12e', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 82290} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'bc0e4ff7cbb1c038c94ad46a2b9599a0f5cbc452d2be34dca05b91565def9859', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 82347} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'b67c5f8ccaaac3f9578e05b2c6b942877b4725c0b162fe5e45bd16e5790c2459', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 83380} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'bd7d5c17df09acb966ab6cd04a7edd38e7ff0ab3cb3b17173c67b5395b2952ab', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 83398} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '802036c4789c1199a5d62c0e6783945631d2484f97a24f1b6c443244c99a7353', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 84497} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '540a062a05ddb526c2dff68d228f8ab18cdda937d16bcc3c300730ddd68e4b4f', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 84516} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '55d55a335becc03627cfa34b9a220814cd884674cb71cd1b2172696a5deefe68', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 86457} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '5ba90512a7228f5e25f98fdcf64c111659694724f7ffe35c365b80b7ff9f42d5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 86477} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-10-02 01:30:07] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001186 CRITICAL:root:Exit data: {'ID': 'fc653b385b0d85cf2cb464462a242f231b8e24e75088e4aa2b8a2cd662670b41', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 91524} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'b09d14ab301b128a5eebb0bb79ce805c7516d590279132c0c0086dad003bcbb6', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f71f97e7fc524279fa410a732f6ff009854047c416bb04d704fe07550fa60472', 'DetachKeys': '', 'Pid': 91559} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes'