New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Nvidia TensorRT-LLM #2271

Draft

abhishekvijeev wants to merge 1 commit into EleutherAI:main from abhishekvijeev:trt_llm

abhishekvijeev commented Sep 1, 2024

Add initial support for Nvidia TensorRT-LLM models
Implement _loglikelihood_tokens() and generate_until() methods


          * Add initial support for Nvidia TensorRT-LLM models

ccf68b4

* Implement _loglikelihood_tokens() and generate_until() methods

CLAassistant commented Sep 1, 2024 •

edited

Loading

All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

haileyschoelkopf Awaiting requested review from haileyschoelkopf haileyschoelkopf will be requested when the pull request is marked ready for review haileyschoelkopf is a code owner

lintangsutawika Awaiting requested review from lintangsutawika lintangsutawika will be requested when the pull request is marked ready for review lintangsutawika is a code owner

baberabb Awaiting requested review from baberabb baberabb will be requested when the pull request is marked ready for review baberabb is a code owner

At least 1 approving review is required to merge this pull request.

Labels

None yet