This roadmap outlines the planned development and priorities for VERONA.
VERONA aims to become the standard framework for scalable and reproducible neural network robustness experiments.
- Roadmap meeting – Finalise this draft in an open meeting with all council members.
- Certified defense with randomized smoothing – Support for certified defense (yielding statistical robustness certificates) methods for image classifiers.
- Vehicle integration for local robustness.
- Vehicle integration for complex properties – Extend to properties with tree structures requiring GPU communication in parallel execution. Add an estimator for this.
- Reduce dependency on AutoVerify.
- Building dedicated interfaces to support adv attacks from foolbox and adversarial-attacks-pytorch
- Support for tree-based models – Add support for decision trees and random forests (based on Marie’s bachelor project + student work).
- Docker support – Provide Docker images for reproducibility and paper-specific setups.
- Maintain AutoVerify / Create lean version.
- Platform independence for AutoVerify – Currently Linux-only.
- Benchmarking – Use VERONA as the benchmarking tool for VNN-COMP.
- Model card integration – Add robustness distributions to Hugging Face model cards.
- [TODO] Add links to PRs open for contributions.
- PyPI release:
ada_veronav1.0.0 on [DATE] ([LINK]) - First draft of roadmap released on [DATE].