feat: add llama-cpp-hermes service with ROCm 6.1 + gfx906 support #54

Merged

gortium merged 3 commits from feat/hermes43-llamacpp into master

2026-07-07 19:00:08 +00:00

Author	SHA1	Message	Date
Hermes	1e290410de	Merge branch 'master' into feat/hermes43-llamacpp Some checks failed Build Hermes agent / build (pull_request) Has been cancelled Details Build ollama (gfx906) / build (pull_request) Has been cancelled Details Conflicts resolved: - hermes env: keep OLLAMA_HOST=ollama-cpu + master's new vars - ollama→ollama-cpu rename: keep our rename over master's ollama	2026-07-07 14:50:59 -04:00
Hermes	80c9906757	fix: rename ollama→ollama-cpu, fix llama-cpp-hermes YAML indentation Some checks failed Build Hermes agent / build (pull_request) Has been cancelled Details Build ollama (gfx906) / build (pull_request) Has been cancelled Details - Rename ollama service to ollama-cpu (CPU-only for bge-m3 embeddings) - Fix llama-cpp-hermes indented under networks instead of as top-level service - Update hermes OLLAMA_HOST to point to ollama-cpu Part of PR #54 GPU/ROCm refactor	2026-07-07 14:29:23 -04:00
Hermes	3c92d93366	feat: add llama-cpp-hermes service with ROCm 6.1 + gfx906 support Some checks failed Build Hermes agent / build (pull_request) Has been cancelled Details Build ollama (gfx906) / build (pull_request) Has been cancelled Details - Add custom llama.cpp Dockerfile with ROCm 6.1 + gfx906 (MI50) build - Add llama-cpp-hermes service serving Hermes 4.3 on dual MI50 GPUs - Strip GPU devices/ROCm env from ollama service (CPU-only for embeddings) Hermes 4.3 runs at ~19 t/s on dual MI50s with 160K context.	2026-06-11 11:41:42 -04:00