Skip to content

FlashMLA support

FlashMLA support #5125

Triggered via pull request March 14, 2025 22:48
Status Failure
Total duration 3m 8s
Artifacts

ci.yml

on: pull_request
Matrix: Check
Matrix: Test Suite
Fit to window
Zoom out
Zoom in

Annotations

68 errors and 69 warnings
Typos
Process completed with exit code 2.
Rustfmt
The process '/home/runner/.cargo/bin/cargo' failed with exit code 1
Check (macOS-latest, stable): mistralrs-core/src/sampler.rs#L430
the trait bound `&mut Isaac64Rng: rand::Rng` is not satisfied
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L663
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `SumAllReduce` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `SumAllReduce` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Check (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (macOS-latest, stable): mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `Isaac64Rng` in the current scope
Check (windows-latest, stable)
The operation was canceled.
Check (windows-latest, stable)
The strategy configuration was canceled because "check.macOS-latest_stable" failed
Check (ubuntu-latest, stable)
The operation was canceled.
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L663
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `SumAllReduce` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `SumAllReduce` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Check (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Check (ubuntu-latest, stable): mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `Isaac64Rng` in the current scope
Check (ubuntu-latest, stable)
The strategy configuration was canceled because "check.macOS-latest_stable" failed
Clippy: mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `mistralrs_quant::SumAllReduce` in the current scope
Clippy: mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Clippy: mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Clippy: mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Clippy: mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `mistralrs_quant::SumAllReduce` in the current scope
Clippy: mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Clippy: mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Clippy: mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `rand_isaac::Isaac64Rng` in the current scope
Clippy: mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Clippy: mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/sampler.rs#L430
the trait bound `&mut Isaac64Rng: rand::Rng` is not satisfied
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L663
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `SumAllReduce` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `SumAllReduce` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Test Suite (macOS-latest, stable): mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (macOS-latest, stable): mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `Isaac64Rng` in the current scope
Test Suite (ubuntu-latest, stable): mistralrs-core/src/sampler.rs#L430
the trait bound `&mut Isaac64Rng: rand::Rng` is not satisfied
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L663
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `SumAllReduce` in the current scope
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `SumAllReduce` in the current scope
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `Isaac64Rng` in the current scope
Test Suite (ubuntu-latest, stable)
The strategy configuration was canceled because "test.macOS-latest_stable" failed
Test Suite (windows-latest, stable)
The operation was canceled.
Test Suite (windows-latest, stable)
The strategy configuration was canceled because "test.macOS-latest_stable" failed
Docs: mistralrs-core/src/sampler.rs#L430
the trait bound `&mut Isaac64Rng: rand::Rng` is not satisfied
Docs: mistralrs-core/src/models/deepseek3.rs#L663
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Docs: mistralrs-core/src/models/deepseek3.rs#L643
no method named `apply` found for struct `SumAllReduce` in the current scope
Docs: mistralrs-core/src/models/deepseek3.rs#L630
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Docs: mistralrs-core/src/models/deepseek3.rs#L608
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Docs: mistralrs-core/src/models/deepseek2.rs#L688
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Docs: mistralrs-core/src/models/deepseek2.rs#L668
no method named `apply` found for struct `SumAllReduce` in the current scope
Docs: mistralrs-core/src/models/deepseek2.rs#L655
failed to resolve: use of undeclared crate or module `candle_flash_mla`
Docs: mistralrs-core/src/models/deepseek2.rs#L633
failed to resolve: use of undeclared crate or module `mistralrs_paged_attn`
Docs: mistralrs-core/src/engine/mod.rs#L105
no function or associated item named `seed_from_u64` found for struct `Isaac64Rng` in the current scope
Typos: ./mistralrs-core/src/models/deepseek2.rs#L514
"absorbtion" should be "absorption".
Typos: ./mistralrs-core/src/models/deepseek3.rs#L489
"absorbtion" should be "absorption".
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
`mistralrs-core` (lib) generated 2 warnings
Check (macOS-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Check (macOS-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Check (ubuntu-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
build failed, waiting for other jobs to finish...
Test Suite (macOS-latest, stable)
`mistralrs-core` (lib) generated 2 warnings
Test Suite (macOS-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L526
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L550
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L484
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L508
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L526
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L550
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L484
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/gguf/gguf_tokenizer.rs#L508
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable): mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
`mistralrs-core` (lib) generated 2 warnings
Docs: mistralrs-core/src/pipeline/amoe.rs#L369
use of deprecated function `rand::thread_rng`: renamed to `rng`
Docs: mistralrs-core/src/pipeline/amoe.rs#L17
use of deprecated function `rand::thread_rng`: renamed to `rng`
Docs
`mistralrs-quant` (lib doc) generated 2 warnings
Docs: mistralrs-quant/src/static_lora.rs#L22
unclosed HTML tag `lora`
Docs: mistralrs-quant/src/static_lora.rs#L21
unclosed HTML tag `lora`
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/