Skip to content

Introduce pipeline configuration files - #8

Merged
lasch merged 3 commits into
IBM:mainfrom
lasch:config_profile
Jul 16, 2025
Merged

Introduce pipeline configuration files#8
lasch merged 3 commits into
IBM:mainfrom
lasch:config_profile

Conversation

@lasch

@lasch lasch commented Jul 14, 2025

Copy link
Copy Markdown
Member

Allows to specify a profile or personality for the processing pipeline (-P <filename>) parameter.

The profile is a json file listing the stages/callback functions in their correct order and specifying whether they should be enabled (true) or not (false). Any name not appearing is as if it was set to false.

This allows to create pre-sets for recurring workflows without requiring to provide a long list of cmd line args.

The default assumes all stages potentially enabled (depending on command line options).

@lasch
lasch requested review from eklee15 and mcalman July 14, 2025 21:32
@lasch lasch added the enhancement New feature or request label Jul 14, 2025
lasch added 3 commits July 14, 2025 17:34
Signed-off-by: Lars Schneidenbach <schneidenbach@us.ibm.com>
Signed-off-by: Lars Schneidenbach <schneidenbach@us.ibm.com>
Signed-off-by: Lars Schneidenbach <schneidenbach@us.ibm.com>

@mcalman mcalman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we silence warning/info logs that don't apply to the selected stages?

For example, with the following profile:

{
    "stages": [
        {"remove_ids_from_name": true}
    ]
}

I get the following logs that aren't relevant with my selected stages:

2025-07-15T10:11:41.507758  WARNING rcu_util counter requested but no compiler log provided. No utilization will be plotted. 
2025-07-15T10:11:43.071832     INFO Partial-overlap slices resolved: 0 
2025-07-15T10:11:43.071880     INFO PEC event stats o/i: 0 / 0 
2025-07-15T10:11:43.071891     INFO PEC event stats o/i: 0 / 0 

Otherwise, all functionality looks good to me!

@lasch

lasch commented Jul 15, 2025

Copy link
Copy Markdown
Member Author

Removing output from deactivated stages is a great suggestion. Lets open an issue to keep this on the radar.

@lasch
lasch merged commit dd4cb50 into IBM:main Jul 16, 2025
@lasch
lasch deleted the config_profile branch July 16, 2025 14:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants