2 Commits

Author	SHA1	Message	Date
Hermes	5db33ddfd2	fix: bump llama.cpp from b9596 to b9890 for slot/stability fixes ... b9596 (Dec 2024) has known slot deadlock on first request causing container freeze. b9890 includes: - Slot selection consolidation (#24755) - HIP fast-math support (#23862) - Hundreds of stability and memory fixes Compatible with ROCm 6.1 + gfx906 (same build flags).	2026-07-07 16:57:22 -04:00
Hermes	3c92d93366	feat: add llama-cpp-hermes service with ROCm 6.1 + gfx906 support ... - Add custom llama.cpp Dockerfile with ROCm 6.1 + gfx906 (MI50) build - Add llama-cpp-hermes service serving Hermes 4.3 on dual MI50 GPUs - Strip GPU devices/ROCm env from ollama service (CPU-only for embeddings) Hermes 4.3 runs at ~19 t/s on dual MI50s with 160K context.	2026-06-11 11:41:42 -04:00