Skip to content

[do not review]eagle cb pipeline impl #2540

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
songbell wants to merge 44 commits into
base: master
Choose a base branch
from
Draft

[do not review]eagle cb pipeline impl #2540

songbell wants to merge 44 commits into from
+3,577 −233

Conversation

@songbell
Copy link

@songbell songbell commented Aug 6, 2025 •
edited by peterchen-intel
Loading

Tickets: CVS-173358

w and others added 13 commits July 7, 2025 17:21
top-k generator for draft model
b28286a 
Signed-off-by: w <1>
@songbell
updated version
28a73fa 
Signed-off-by: fishbell <[email protected]>
@songbell
v2
fd58e61 
Signed-off-by: fishbell <[email protected]>
@songbell
support eagle2
6d728ba 
Signed-off-by: fishbell <[email protected]>
@songbell
fix cb issue
d943850 
Signed-off-by: fishbell <[email protected]>
@songbell
opt inital state indexing
d940b43 
Signed-off-by: fishbell <[email protected]>
@songbell
handle request finish
bcc5e2f 
Signed-off-by: fishbell <[email protected]>
@songbell
Merge branch 'master' of https://github.com/openvinotoolkit/openvino.…
30e9e8b 
…genai into bell/eagle2_part1
@songbell
fix merge conflict
476af89 
Signed-off-by: fishbell <[email protected]>
@songbell
fix issue
5180e37 
Signed-off-by: fishbell <[email protected]>
@songbell
remove redundant copy
36e05eb 
Signed-off-by: fishbell <[email protected]>
@songbell
commit stash content
9ca6539 
Signed-off-by: fishbell <[email protected]>
@songbell
clear sample interface
89cd543 
Signed-off-by: fishbell <[email protected]>
@github-actions github-actions bot added category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: cmake / build Cmake scripts category: LLM samples GenAI LLM samples category: CPP API Changes in GenAI C++ public headers no-match-files labels Aug 6, 2025
@songbell songbell changed the title eagle2 impl [do not review]eagle2 impl Aug 6, 2025
@github-actions github-actions bot added the category: LoRA Low rank adapters label Aug 7, 2025
@songbell
eagle3 support
1553bcd 
Signed-off-by: fishbell <[email protected]>
@github-actions github-actions bot added category: llm_bench Label for tool/llm_bench folder category: Python API Python API for GenAI labels Aug 22, 2025
@songbell songbell changed the title [do not review]eagle2 impl [do not review]eagle cb pipeline impl Sep 2, 2025
@peterchen-intel
Copy link
Collaborator

peterchen-intel commented Sep 21, 2025 •
edited
Loading

Replaced by #2740 ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@wangleis wangleis Awaiting requested review from wangleis

Copilot code review Copilot Awaiting requested review from Copilot Copilot will automatically review once the pull request is marked ready for review

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

category: cmake / build Cmake scripts category: continuous batching Continuous batching category: CPP API Changes in GenAI C++ public headers category: llm_bench Label for tool/llm_bench folder category: LLM samples GenAI LLM samples category: LLM LLM pipeline (stateful, static) category: LoRA Low rank adapters category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding do_not_merge do_not_review no-match-files

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@songbell @peterchen-intel @xufang-lisa