Skip to content

Conversation

@ilana-n
Copy link

@ilana-n ilana-n commented Oct 20, 2025

Add AIPerf Visualization Feature Design Plan

Proposes aiperf plot command to generate visualizations from profiling results.

Key features:

  • Three visualization modes: static PNG (default), interactive HTML (offline), and live server dashboard
  • Auto-detects multi-run comparison vs single-run analysis
  • Supports all AIPerf metrics with configurable plot presets
  • User configuration via ~/.aiperf/config.yaml

Includes:

  • Complete design specification with requirements and architecture
  • Configuration examples for custom plot definitions
  • Visual mockups showing example outputs
  • Design plan template and reference materials

This addresses the common need to visualize performance metrics, compare runs, and analyze trade-offs without external tools.

@ilana-n ilana-n changed the title feat: add aiperf viz DEP feat: add DEP for AIPerf sweep and visualization commands Oct 20, 2025
Copy link

@lkomali lkomali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job on detailing the project. Liked the idea of interactive plots.
I have some comments, open to discuss.

In general, my opinion is that analyze and plot should be decoupled.

  • profile will benchmark and generate results. Users might want to visualize individual runs as well as compare across runs.
  • analyze will sweep across different values for a parameter and provide results. Users running analyze may or may not want to visualize their results.
  • plot should be able to visualize results coming both the above subcommands. Users should be able to visualize given a set of result files irrespective of the step before ran profile or analyze command.

@ilana-n ilana-n changed the title feat: add DEP for AIPerf sweep and visualization commands feat: add DEP for AIPerf visualization command Oct 22, 2025
@ilana-n ilana-n requested a review from lkomali October 23, 2025 01:15
@ilana-n ilana-n changed the title feat: add DEP for AIPerf visualization command feat: DEP for AIPerf Visualization Feature and Plot Command Oct 23, 2025
@coderabbitai
Copy link

coderabbitai bot commented Oct 23, 2025

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@the-david-oy
Copy link

This is a great proposal.

Copy link

@lkomali lkomali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm halfway through it, but really good design.
Have a couple of small comments.
Will take another pass for the other half.

Copy link

@lkomali lkomali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Great work @ilana-n

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants