This is Arandu, an app to help with Llama.cpp usage, the idea is to create a small system around llama-server without need to hook with the dll files.
- Model management
- HuggingFace Integration
- Llama.cpp GitHub Integration with releases management
- Llama-server terminal launching with easy arguments customization and presets, Internal / External
- Llama-server native chat UI integrated
- Hardware monitor
- Color themes
- Cleanup code and organize it better
- Make compatible with Linux and Mac
Use cargo tauri build, it will output to backend\target\release.
https://github.com/fredconex/Arandu/releases
