The PIQA integration doesn't calculate or display the baseline acc_norm at the start (at least it didn't show up in the logs on my end). Without this, Optuna has no reference point to evaluate quality degradation. KL divergence has an inherent baseline of 0, and refusals are explicitly measured at the start, PIQA acc_norm baseline on original models needs the same treatment.
The PIQA integration doesn't calculate or display the baseline acc_norm at the start (at least it didn't show up in the logs on my end). Without this, Optuna has no reference point to evaluate quality degradation. KL divergence has an inherent baseline of 0, and refusals are explicitly measured at the start, PIQA acc_norm baseline on original models needs the same treatment.