feat(hermes): add voice support with GPU-accelerated STT #14

Closed
Hermes wants to merge 2 commits from feat/hermes-voice-gpu-support into master
Collaborator

Summary

Adds local Speech-to-Text (STT) capabilities to Hermes Agent with GPU acceleration for AMD MI50 GPUs.

Changes

  • hermes service: Changed from image: to build: to use custom Dockerfile
  • ROCm environment variables: Added GPU acceleration settings for faster-whisper
    • HSA_OVERRIDE_GFX_VERSION=9.0.6
    • HCC_AMDGPU_TARGET=gfx906
    • HIP_VISIBLE_DEVICES=0,1
    • ROCR_VISIBLE_DEVICES=0,1
    • HSA_ENABLE_SDMA=0

Why This Approach

Decision Rationale
Extend upstream image Maintains compatibility with official Hermes releases
Build locally Ensures reproducible builds with voice dependencies
ROCm env vars Required for AMD GPU acceleration in faster-whisper
## Summary Adds local Speech-to-Text (STT) capabilities to Hermes Agent with GPU acceleration for AMD MI50 GPUs. ## Changes - **hermes service**: Changed from `image:` to `build:` to use custom Dockerfile - **ROCm environment variables**: Added GPU acceleration settings for faster-whisper - `HSA_OVERRIDE_GFX_VERSION=9.0.6` - `HCC_AMDGPU_TARGET=gfx906` - `HIP_VISIBLE_DEVICES=0,1` - `ROCR_VISIBLE_DEVICES=0,1` - `HSA_ENABLE_SDMA=0` ## Why This Approach | Decision | Rationale | |----------|-----------| | Extend upstream image | Maintains compatibility with official Hermes releases | | Build locally | Ensures reproducible builds with voice dependencies | | ROCm env vars | Required for AMD GPU acceleration in faster-whisper | ## Related - Parent PR (infra): https://code.lazyworkhorse.net/gortium/infra/pulls/new/feat/hermes-voice-gpu-support
Hermes added 2 commits 2026-04-30 15:15:20 +00:00
- Change hermes service from image: to build:
- Enables custom image with libportaudio2 and voice Python packages
Hermes closed this pull request 2026-05-09 00:21:17 +00:00

Pull request closed

Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: gortium/compose#14
No description provided.