Issues

• MCP spec conformance (math-mcp example): 1 requirement violated (via @hasmcp/mcp-spec-test) — spec 2025-11-25

  Accenture/mcp-bench#42 · Filter by author hasmcp-dev opened on Aug 24, 2026

• MCP spec conformance (math-mcp example): 7 requirements violated (via @hasmcp/mcp-spec-test) — spec 2026-07-28

  Accenture/mcp-bench#41 · Filter by author hasmcp-dev opened on Aug 24, 2026

• Protocol review request: AANA pre-tool-call safety/reliability track

  Accenture/mcp-bench#33 · Filter by author mindbomber opened on May 7, 2026
  5

• Question About Multi-Server Task Counts in the Dataset

  Accenture/mcp-bench#28 · Filter by author unxx-10 opened on Dec 8, 2025
  1

• Clarification on "Overall Score" calculation logic

  Accenture/mcp-bench#25 · Filter by author yikeyang33 opened on Nov 29, 2025
  1

• GOOGLE API

  Accenture/mcp-bench#24 · Filter by author DuanyangYuan opened on Nov 4, 2025
  1

• Total: 0 models

  Accenture/mcp-bench#23 · Filter by author DuanyangYuan opened on Nov 3, 2025
  10

• GOOGLE_MAPS_API_KEY

  Accenture/mcp-bench#21 · Filter by author DuanyangYuan opened on Nov 3, 2025
  1

• MCP connection error

  Accenture/mcp-bench#20 · Filter by author LDlornd opened on Oct 17, 2025
  10

• Where can I save the agent's trajectory? I

  Accenture/mcp-bench#18 · Filter by author WEYAI opened on Sep 29, 2025
  3

• Only 52 out of 56 tasks were successful.

  Accenture/mcp-bench#17 · Filter by author WEYAI opened on Sep 29, 2025
  4

• Results have no scores except task_success_rate

  Accenture/mcp-bench#16 · Filter by author yongyct opened on Sep 24, 2025
  1

• Computation/rescale for the overall and each-item score

  Accenture/mcp-bench#15 · Filter by author 1998v7 opened on Sep 12, 2025
  3

• Available models: Total: 0 models

  Accenture/mcp-bench#13 · Filter by author weslayzhang opened on Sep 9, 2025
  1

• Trajectories for baselines

  Accenture/mcp-bench#9 · Filter by author lewtun opened on Sep 2, 2025
  2

• Release MCP-Bench Tasks on Hugging Face

  Accenture/mcp-bench#7 · Filter by author NielsRogge opened on Aug 31, 2025