gortium/infra
1
1
Fork 0
Code Issues 13 Pull Requests 24 Actions Packages Projects 1 Releases Wiki Activity

feat: update compose submodule for Hermes 4.3 llama-cpp service #72

Open
Hermes wants to merge 1 commits from feat/hermes43-llamacpp into master
pull from: feat/hermes43-llamacpp
merge into: gortium:master
Conversation 0 Commits 1 Files Changed 1 +1 -1
Hermes commented 2026-06-11 15:47:11 +00:00
Collaborator
Copy Link

Summary

Updates the assets/compose submodule to include the new llama-cpp-hermes service for running Hermes 4.3 on dual MI50 GPUs.

What's included

  • New compose service llama-cpp-hermes: Custom llama.cpp (b9596) built with ROCm 6.1 + gfx906. Serves Hermes 4.3 at ~19 t/s with 160K context on both MI50s.
  • Updated ollama service: Stripped of GPU access — runs CPU-only for bge-m3 embeddings.
  • New Dockerfile: assets/compose/ai/llama-cpp/Dockerfile for the custom ROCm build.

PRs

## Summary Updates the `assets/compose` submodule to include the new `llama-cpp-hermes` service for running Hermes 4.3 on dual MI50 GPUs. ## What's included - **New compose service `llama-cpp-hermes`**: Custom llama.cpp (b9596) built with ROCm 6.1 + gfx906. Serves Hermes 4.3 at ~19 t/s with 160K context on both MI50s. - **Updated `ollama` service**: Stripped of GPU access — runs CPU-only for bge-m3 embeddings. - **New Dockerfile**: `assets/compose/ai/llama-cpp/Dockerfile` for the custom ROCm build. ## PRs - Compose changes: https://code.lazyworkhorse.net/gortium/compose/pulls/54
Hermes added 1 commit 2026-06-11 15:47:12 +00:00
feat: update compose submodule for Hermes 4.3 llama-cpp service 79210235fe
This pull request has changes conflicting with the target branch.
  • assets/compose
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin feat/hermes43-llamacpp:feat/hermes43-llamacpp
git checkout feat/hermes43-llamacpp
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
Compat/Breaking
Breaking change that won't be backward compatible
Kind/Bug
Something is not working
Kind/Documentation
Documentation changes
Kind/Enhancement
Improve existing functionality
Kind/Feature
New functionality
Kind/Security
This is security issue
Kind/Testing
Issue or pull request related to testing
Priority
Critical
1
The priority is critical
Priority
High
2
The priority is high
Priority
Low
4
The priority is low
Priority
Medium
3
The priority is medium
Reviewed
Confirmed
1
Issue has been confirmed
Reviewed
Duplicate
2
This issue or pull request already exists
Reviewed
Invalid
3
Invalid issue
Reviewed
Won't Fix
3
This issue won't be fixed
Status
Abandoned
3
Somebody has started to work on this but abandoned work
Status
Blocked
1
Something is blocking this issue or pull request
Status
Need More Info
2
Feedback is required to reproduce issue or to continue work
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Hermes gortium
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: gortium/infra#72
No description provided.
Delete Branch "feat/hermes43-llamacpp"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?