Skip to content

Fix: Disable reranker by default as it is not yet implemented#5

Open
echobt wants to merge 1 commit intomainfrom
fix/issue-24-reranker-not-implemented
Open

Fix: Disable reranker by default as it is not yet implemented#5
echobt wants to merge 1 commit intomainfrom
fix/issue-24-reranker-not-implemented

Conversation

@echobt
Copy link
Copy Markdown
Contributor

@echobt echobt commented Jan 19, 2026

Summary

This fix addresses the issue where the reranker feature is documented and configured as enabled by default, but is never actually used in the codebase.

Problem

The reranker functionality was advertised in documentation and enabled by default in configuration, causing users to download a ~400MB reranker model (Qwen3-Reranker-0.6B-Q4_K_M.gguf). However, the actual implementation in src/core/search.rs explicitly disables the reranker with a comment stating it requires a separate backend that conflicts with the embedding engine.

This results in:

  • Wasted bandwidth downloading an unused 400MB model
  • Wasted disk space storing the unused model
  • User confusion when the documented feature has no effect

Solution

  1. Changed use_reranker default from true to false in src/config.rs
  2. Modified vgrep models download command to only download the embedding model by default
  3. The reranker model can still be downloaded explicitly using --reranker-only flag for future use
  4. Updated README.md to clearly indicate that reranker is not yet implemented

Testing

  • Verified that default configuration no longer enables reranker
  • Verified that vgrep models download only downloads the embedding model
  • Verified that vgrep models download --reranker-only still works for those who want the model

Related Issue

Fixes PlatformNetwork/bounty-challenge#24

The reranker feature was documented and configured as enabled by default but the actual implementation in search.rs explicitly disables it with a comment stating it requires a separate backend. This caused users to download a ~400MB reranker model that was never used.

Changes:

- Set use_reranker default to false in config.rs

- Only download reranker model when explicitly requested with --reranker-only flag

- Update README.md to clarify reranker status as not yet implemented

 -m Fixes PlatformNetwork/bounty-challenge#24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Reranker Feature is Documented and Downloaded But Never Used

1 participant