Search results

Check endpoint method in nemo-evaluator does not allow vlm endpoint type

bugSomething isn't workingSomething isn't working

Status: Open.

#714 In NVIDIA-NeMo/Evaluator;

· athitten opened on Feb 10, 2026

Update nemo-run script to use MBridge

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#695 In NVIDIA-NeMo/Evaluator;

· athitten opened on Feb 4, 2026

·  

26.02

[Nemo fw] Support tool calling benchmarks evaluation in NeMo FW

enhancementNew feature or requestNew feature or request

Status: Open.

#694 In NVIDIA-NeMo/Evaluator;

· athitten opened on Feb 4, 2026

·  

26.04

[Nemo FW] Support chat benchmarks with TRTLLM models

enhancementNew feature or requestNew feature or request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#686 In NVIDIA-NeMo/Evaluator;

· athitten opened on Feb 2, 2026

·  

26.04

Support asynchronous evaluation during training

backlog

enhancementNew feature or requestNew feature or request

Status: Open.

#377 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 23, 2025

Support evaluation of TRTLLM checkpoints on logprob benchmarks

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#368 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 21, 2025

·  

26.04

Support chat benchmarks with MBridge, HF models

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#332 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 15, 2025

·  

26.02

Evaluation support for multimodal models in Megatron Bridge

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#279 In NVIDIA-NeMo/Evaluator;

· athitten opened on Oct 6, 2025

·  

26.04

[Feature Request] Support chat format in the llm generate APi

support

Status: Open.

#49 In NVIDIA-NeMo/Evaluator;

· snowmanwwg opened on Aug 4, 2025

Support evaluation of TRTLLM checkpoints on generation benchmarks

Status: Open.

#46 In NVIDIA-NeMo/Evaluator;

· snowmanwwg opened on Aug 3, 2025

·  

26.02