Skip to content

PIQA integration missing baseline acc_norm calculation at start of process #246

@erm14254

Description

@erm14254

The PIQA integration doesn't calculate or display the baseline acc_norm at the start (at least it didn't show up in the logs on my end). Without this, Optuna has no reference point to evaluate quality degradation. KL divergence has an inherent baseline of 0, and refusals are explicitly measured at the start, PIQA acc_norm baseline on original models needs the same treatment.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions