INFO: =================== Thu Sep 11 01:27:27 AM UTC 2025 =================== /contrail-functions.sh: line 167: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory /contrail-functions.sh: line 202: /etc/contrail/vnc_api_lib.ini.tmp: No such file or directory mv: cannot stat '/etc/contrail/vnc_api_lib.ini.tmp': No such file or directory [DEFAULTS] http_server_ip=0.0.0.0 log_file=/var/log/contrail/database-nodemgr/contrail-database-nodemgr.log log_level=SYS_NOTICE log_local=1 hostip=10.0.0.48 db_port=9042 db_jmx_port=7200 db_use_ssl=False [COLLECTOR] server_list=10.0.0.48:8086 [SANDESH] introspect_ssl_enable=False sandesh_ssl_enable=False [DEFAULTS] minimum_diskGB = 2 09/11/2025 01:27:28.145 7efe5ad928c0 [contrail-database-nodemgr] [INFO]: SANDESH: CONNECT TO COLLECTOR: True 09/11/2025 01:27:28.233 7efe5ad928c0 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/11/2025 01:27:28.239 7efe5ad928c0 [contrail-database-nodemgr] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8103 09/11/2025 01:27:28.243 7efe5ad928c0 [contrail-database-nodemgr] [ERROR]: Failed to import package "database.sandesh" 09/11/2025 01:27:28.248 7efe5ad928c0 [contrail-database-nodemgr] [INFO]: SANDESH: Logging: LEVEL: [SYS_INFO] -> [SYS_NOTICE] CRITICAL:root:Exit data: {'ID': 'a0cb4016c42f90ee3bc4534d36677169c8ca346a5d48605bd45dd22aeb6f2758', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 70758} ERROR:contrail-database-nodemgr:Failed to connect to database by CQL and socket: Result: 1 CRITICAL:root:Exit data: {'ID': '837678fe3dab824a7a04194d6e884c3a77feef71d993764acd85a6bf7a89f823', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 70785} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '7b997220c165d81d13cf322cd28c03f859b1decb820d27a2088fc78adde302e3', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 75346} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '2bb6add170129d403233613cb919da73e9610a5c3944a113f4a01938decfa83a', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 75365} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-11 01:29:44] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001179 [Introspect:8103]10.0.0.48 - - [2025-09-11 01:29:47] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001097 CRITICAL:root:Exit data: {'ID': '6f101184ab9bf94418d086917581ab79bd3d7ca3b256014a171c04afc7420fb2', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 77349} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '4193530c28a348532c15eb5fe2b9efb822c68c1ff16cdcd82597108150d56208', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 77368} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '96575732d3f7c12b194a3fae962c32ddd67ea2b23cc63d62f658562ff4a232cb', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 80150} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'da94e6dc8af5d72bf8e99635411c6a6dac4ed385acada671bfc4cf9459fda8c9', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 80168} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '96a6bdbf07d6566a18e59b643b4ae08db763eee63eefec0a279fa96ff1033577', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 83268} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '776c93b0621b3273f02104f8dc0aa5a43b040ee622d9110a18c72d04af2b6d61', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 83289} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'dbd3dd68b5dce1fcef4bc2f29af2ff28f35a4acf308fe6eae570d1081061a1fe', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 84469} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'feeb5815e5f5c61db3168c6099bf991d3cdd1a745101215b023d6ac1d5765f31', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 84487} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': '04e102783662acb958b0331f8239768da9df9adfeac12238510357567bada160', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 85529} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '961fc878d60dcc3594106bdb1b52e23525a2973fda7d2e4e3e9bcf67b7809006', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 85560} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'c9455caba6dd7082e644b9ee70a84c1bdcfa50187288920ba52aff693a475766', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 86721} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': 'ff0dd593ec3b2cffaba4acf9d5ef4023394ef69cdf14657e42b9d30f6cbaf2c5', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 86777} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' CRITICAL:root:Exit data: {'ID': 'f1a87c83d3da2c406e5d20c3e35faa175193f851c85ece27f57fe38b9acc261d', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 88972} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '3282ec1a1a30171724933dc00a8a3a8a55cae78296d64d3ca6ed33dfc149d997', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 88990} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' [Introspect:8103]10.0.0.48 - - [2025-09-11 01:37:01] "GET /Snh_SandeshUVECacheReq?x=NodeStatus HTTP/1.1" 200 6716 0.001575 CRITICAL:root:Exit data: {'ID': 'cd674e4074f0d290766e14234f71525104e85c8bad593867ea52cbaaf661461f', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'cqlsh', 'arguments': ['10.0.0.48', '9042', '-e', 'quit'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 94791} WARNING:contrail-database-nodemgr:CQLSH failed, but Cassandra native transport port is open CRITICAL:root:Exit data: {'ID': '996bf96508512cf48397033f0c13b9d6f4c3e3ff902f25afd414c26d859cf31c', 'Running': False, 'ExitCode': 1, 'ProcessConfig': {'tty': True, 'entrypoint': 'nodetool', 'arguments': ['-p', '7200', 'compactionstats'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': '630591f7f7c9d144505ae5b2ce628b5351f28dcf90010ef985f315e693b6c709', 'DetachKeys': '', 'Pid': 94824} ERROR:contrail-database-nodemgr:Failed to get nodetool compactionstats: Result: 1 ERROR:contrail-database-nodemgr:Failed to get core files: [Errno 2] No such file or directory: '/var/crashes'