There are three experiments involved:
- Modern risk curve for DL:
risk_curve.py
andrisk_curve_evaluate_model.py
- Measure intrinsic dimensions:
intrinsic_dimensions.py
andintrinsic_dimensions_measurement.py
- Measure re-initialization and re-randomization robustness of layers:
layer_equality.py
See blog post "Are Deep Neural Networks Dramatically Overfitted?" for more details.