Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REQUEST] Download subcommand for main script #279

Open
3 tasks done
kingbri1 opened this issue Feb 8, 2025 · 0 comments
Open
3 tasks done

[REQUEST] Download subcommand for main script #279

kingbri1 opened this issue Feb 8, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@kingbri1
Copy link
Member

kingbri1 commented Feb 8, 2025

Problem

Downloading models from huggingface is difficult and users need to work through a lot of extra steps just to get a model on their system.

Solution

Add a subcommand ex. python main.py download <download args> which downloads a model using tabbyAPI's downloader

Alternatives

huggingface-cli and async-hf-downloader

Explanation

Downloading a model shouldn't be a cumbersome task. While available via the API, downloading is primarily done via terminal or a GUI based method and installing the required tools can be difficult for a new user. By adding a subcommand, args can be passed to tabby's download script which dramatically simplifies the process.

Examples

No response

Additional context

No response

Acknowledgements

  • I have looked for similar requests before submitting this one.
  • I understand that the developers have lives and my issue will be answered when possible.
  • I understand the developers of this program are human, and I will make my requests politely.
@kingbri1 kingbri1 added the enhancement New feature or request label Feb 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant