Skip to content

Commit

Permalink
update gpt-2 example
Browse files Browse the repository at this point in the history
  • Loading branch information
slaren committed Jan 12, 2024
1 parent 9b59023 commit 1c68bcf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/gpt-2/main.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -947,7 +947,7 @@ int main(int argc, char ** argv) {
ggml_backend_sched_t sched;
{
// initialize the scheduler
sched = ggml_backend_sched_new(model.backends.data(), model.backends.size());
sched = ggml_backend_sched_new(model.backends.data(), NULL, model.backends.size(), GPT2_MAX_NODES);

// create the worst case graph for memory usage estimation
int n_tokens = std::min(model.hparams.n_ctx, params.n_batch);
Expand Down

0 comments on commit 1c68bcf

Please sign in to comment.