Skip to content

feat(gallery): add Granite 4.2 variants - #11719

Merged
mudler merged 1 commit into
masterfrom
cron/model-gallery-20260825-run3
Aug 26, 2026
Merged

feat(gallery): add Granite 4.2 variants#11719
mudler merged 1 commit into
masterfrom
cron/model-gallery-20260825-run3

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Adds the official IBM Granite 4.2 GGUF models in 3B, 8B, and 30B sizes. Each size includes Q4_K_M and Q8_0 builds connected through gallery variants.

The entries use llama.cpp with the embedded Jinja tokenizer template for multilingual chat, reasoning, coding, and tool use.

Verification

  • Confirmed all six SHA256 values against Hugging Face x-linked-etag
  • Confirmed all model and artifact URLs return successfully
  • Confirmed Granite 4.2 uses the dense Granite architecture supported by the pinned llama.cpp revision
  • git diff --check https-origin/master...HEAD
  • Independent gallery review passed
  • go test ./core/gallery could not start locally because generated pkg/grpc/proto sources are absent; make protogen-go was blocked when the environment proxy rejected the protoc download

Notes for Reviewers

CI should provide the generated protobuf prerequisite and run the gallery suite.

Signed commits

  • Yes, I signed my commits.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Add the official IBM Q4_K_M and Q8_0 GGUF builds for the 3B, 8B, and 30B Granite 4.2 models.

Assisted-by: Codex:gpt-5.6-sol
@mudler
mudler marked this pull request as ready for review August 26, 2026 07:01
@mudler
mudler merged commit 5dab4fc into master Aug 26, 2026
56 of 57 checks passed
@mudler
mudler deleted the cron/model-gallery-20260825-run3 branch August 26, 2026 07:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants