Skip to content

Update Docker Docs and Examples (Published Images, GGUF, Qwen3 TTS)#107

Merged
0xShug0 merged 1 commit into
0xShug0:mainfrom
xashr:docs/update_docker_docs_examples_pr
Jul 26, 2026
Merged

Update Docker Docs and Examples (Published Images, GGUF, Qwen3 TTS)#107
0xShug0 merged 1 commit into
0xShug0:mainfrom
xashr:docs/update_docker_docs_examples_pr

Conversation

@xashr

@xashr xashr commented Jul 25, 2026

Copy link
Copy Markdown
Contributor

Summary

This PR now updates the Docker documentation and examples to reflect the current state:

  • Reference published images from ghcr.io/0xshug0/audio.cpp as primary source for images, local builds still supported
  • Switch to GGUF models from https://huggingface.co/audio-cpp/audio.cpp-gguf
  • Add Qwen3 TTS as second example to demonstrate voice cloning
  • Add ToC, clean up, etc.

@xashr
xashr marked this pull request as draft July 25, 2026 11:09
@xashr

xashr commented Jul 25, 2026

Copy link
Copy Markdown
Contributor Author

@0xShug0 Currently we have /Docker.md and /docs/docker.md . We should only maintain/keep one of them. Any preference? Keep Docker.md or switch to /docs/docker.md ?

Unfortunately I also noticed that the Qwen3 TTS3 does not work with CUDA in the container. Not related to this PR, but might be a regression from #84 . It's due to torch_random.cpp and #ifdef GGML_USE_CUDA . ==> Created #109

ggml_cuda_init: found 1 CUDA devices (Total VRAM: 32107 MiB):
  Device 0: NVIDIA GeForce RTX 5090, compute capability 12.0, VMM: yes, VRAM: 32107 MiB
load_backend: loaded CUDA backend from /app/libggml-cuda.so
load_backend: loaded CPU backend from /app/libggml-cpu-alderlake.so
audiocpp_cli failed: Qwen3 TTS generation requires a build with CUDA support

@xashr xashr changed the title Update Docker Docs and Examples (Publishes Images, GGUF, Qwen3 TTS) Update Docker Docs and Examples (Published Images, GGUF, Qwen3 TTS) Jul 25, 2026
@0xShug0

0xShug0 commented Jul 25, 2026

Copy link
Copy Markdown
Owner

@xashr Let's use docs/docker.md

I also noticed the regression because of #102. I merged the PR last night. Did you try the latest commit?

… support, and Qwen3-TTS

- Update Docker.md to reflect published images (ghcr.io/0xshug0/audio.cpp)
  instead of requiring local builds
- Add table of contents and document available backends (cuda12/cuda13/cpu)
  and architectures (amd64/arm64)
- Migrate examples to GGUF models (PocketTTS-GGUF, Qwen3-TTS-GGUF)
- Add Qwen3-TTS examples with voice cloning (CLI + server)
- Split server examples per model and backend (YAML, JSON, shell scripts)
- Move Docker.md from repo root to docs/docker.md
@xashr
xashr force-pushed the docs/update_docker_docs_examples_pr branch from 1ffc764 to 0d65099 Compare July 25, 2026 21:28
@xashr

xashr commented Jul 25, 2026

Copy link
Copy Markdown
Contributor Author

I see you merged PR #109 already. Great, that fixed the Qwen3 TTS example.

README.md references docs/docker.md now.

@xashr
xashr marked this pull request as ready for review July 25, 2026 21:33
@0xShug0
0xShug0 merged commit 10287cb into 0xShug0:main Jul 26, 2026
4 checks passed
@0xShug0

0xShug0 commented Jul 26, 2026

Copy link
Copy Markdown
Owner

@xashr Merged! Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants