Skip to content

Idun-Group/cohere-tiny-aya-exp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cohere x Idun

Multilingual Support Agent with Tiny Aya

A LangGraph agent that translates and triages multilingual support tickets using Cohere's Tiny Aya (3.35B params), deployed on the Idun Agent Platform.

📖 Read the blog post →


Agent output

Evaluation results

Model Score/Second Score/Param
TinyAya-Global 0.546 0.275
Qwen3-32B 0.455 0.030
Qwen3-4B 0.362 0.236
Qwen3-8B 0.222 0.119
Gemma3n-E4B 0.214 0.243
Qwen3.5-27B 0.037 0.036

Setup

git clone https://github.com/Idun-Group/cohere-tiny-aya-exp.git
cd cohere-tiny-aya-exp
cp .env.example .env  # fill in HF_TOKEN and GEMINI_API_KEY
uv sync

Usage

Command What it does
make run TICKET=SCRUM-136 Run the agent on a Jira ticket
make generate Generate test tickets
make eval Run the evaluation suite

Where to look

  • Agent graphsrc/agents/graph.py, nodes in src/agents/nodes/
  • Tiny Aya wrapper + routingsrc/models/
  • MCP tools (Jira)src/mcp_tools.py, configured in idun_config.yaml
  • Evalsevals/test_model_comparison.py, dataset in evals/datasets/tickets.json, results in evals/results/, charts in evals/report/

Links

About

Cohere Tiny aya experiment

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors