-
Notifications
You must be signed in to change notification settings - Fork 0
xl-agent benchmark: Cats Effect CPU starvation warnings during streaming #198
Copy link
Copy link
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Problem
When running benchmarks with --stream flag, Cats Effect emits repeated CPU starvation warnings:
WARNING: Your app's responsiveness to a new asynchronous event (such as a new connection,
an upstream response, or a timer) was in excess of 100 milliseconds. Your CPU is probably
starving. Consider increasing the granularity of your delays or adding more cedes. This may
also be a sign that you are unintentionally running blocking I/O operations (such as File
or InetAddress) without the blocking combinator.
This warning appears 80+ times during a single benchmark run.
Likely Cause
Blocking I/O operations (file reads, network calls) not wrapped in IO.blocking { ... } or IO.interruptible { ... }.
Areas to Investigate
- File operations in benchmark runner - reading/writing Excel files
- Network calls to Anthropic API - might need proper async handling
- Process execution - running
xlCLI commands
Files to Check
xl-agent/src/com/tjclp/xl/agent/benchmark/- Benchmark runner codexl-agent/src/com/tjclp/xl/agent/anthropic/- API client code
Impact
- Performance degradation during benchmarks
- Potential timeout issues
- Not a correctness bug, but affects reliability
Context
Observed during SpreadsheetBench task 2768 with --parallelism 3 --stream flags.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working