Skip to content

Issues: nod-ai/shark-ai

Migrate workflows to OSSCI
#793 opened Jan 8, 2025 by yamiyysu
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

96 Open 58 Closed
96 Open 58 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Bad results when serving Llama3.1_8b_f16 with shortfin
#934 opened Feb 7, 2025 by Alex-Vasile
5
Tiny model for shortfin CI
#933 opened Feb 7, 2025 by renxida
1
Pin iree packages in nightly shark-ai releases
#929 opened Feb 7, 2025 by ScottTodd
@ScottTodd @marbre
[shortfin_apps.llm] More models in integration tests
#927 opened Feb 6, 2025 by renxida
@renxida
Set up HF_HUB_CACHE for OSSCI Machines
#926 opened Feb 6, 2025 by renxida
@Eliasj42
1
[shortfin_apps.llm] Batcher-level generation tests
#923 opened Feb 6, 2025 by renxida
[shortfin_apps.llm] Unit tests and smaller-chunk integration tests
#922 opened Feb 6, 2025 by renxida
@renxida
[WIP] LLM Server Release v3.3.0
#921 opened Feb 5, 2025 by stbaione
@renxida @stbaione
1
Dashboard to see shortfin/sglang benchmark tests performance progress / detect regress infra General category for infrastructure-related requests for common triaging and prioritization
#920 opened Feb 5, 2025 by renxida
[shortfin llm] Consolidate model artifacts download / compile in sglang benchmark tests, sglang integration tests, and shortfin integration tests infra General category for infrastructure-related requests for common triaging and prioritization
#911 opened Feb 4, 2025 by renxida
[shortfin_apps/llm] Need documentation for SystemManager: sysman.ls.create_worker() hangs if ran immediately after sysman.start()
#906 opened Feb 4, 2025 by renxida
[tracking][shortfin] Shortfin reliability / iree integration issues
#904 opened Feb 3, 2025 by renxida
[shortfin/llm] Metrics endpoint enhancement New feature or request
#901 opened Feb 3, 2025 by renxida
@renxida
Metrics endpoint for shortfin apps (llm / sd)
#900 opened Feb 3, 2025 by renxida
2
Job timeouts in "CI - sharktank / Data-dependent Tests" after updating IREE versions bug Something isn't working
#888 opened Jan 30, 2025 by ScottTodd
5 tasks
@sogartar
12
Split pkgci_shark_ai.yml for (short / long-running) X (cpu / gpu)
#883 opened Jan 29, 2025 by renxida
update generate_inputs.py to use torch tensors
#881 opened Jan 29, 2025 by dan-garvey
[sharktank][llama] get fp8 llama tests working
#880 opened Jan 29, 2025 by dan-garvey
@dan-garvey
[shortfin][ci] Flaky startup timer test failure
#872 opened Jan 27, 2025 by dan-garvey
2
Plan for testing on unstable version of ROCm for future releases. infra General category for infrastructure-related requests for common triaging and prioritization
#861 opened Jan 23, 2025 by wbachani
@saienduri @amd-chrissosa
[RFC] Lightweight Client for shortfin enhancement New feature or request
#850 opened Jan 20, 2025 by monorimet
@bjacobgordon
11
TSan reports thread leaks on ctests bug Something isn't working
#846 opened Jan 20, 2025 by bjacob
1
[tuner] Candidate specs should be annonated with default unit attr
#816 opened Jan 12, 2025 by bangtianliu
@bangtianliu
[Tuner] Improving ease of use for the tuner tuner
#814 opened Jan 10, 2025 by Max191
15 tasks
@kuhar @bangtianliu @Max191
4
[Tuner] Add tests to account for runtime failures tuner
#811 opened Jan 10, 2025 by kuhar
@bangtianliu @Max191
ProTip! What’s not been updated in a month: updated:<2025-01-07.