Updates on CONFIDENCE #12
Description
Confidence just had a major update to address melusina-org/cl-confidence#2 and to ensure the changes are not breaking compatibility I also ran the UAX-15 testsuite.
On my system this divided the execution time of the UAX-15 testsuite by four without changing significantly the BYTES-CONSED row. I believe you were interested by the performance of tests framework, so here are a few details:
Current code melusina-org/cl-confidence@3d1509c yields the foillowing trivial benchmark on UAX-15 testsuite (my machine):
- SAMPLES TOTAL MINIMUM MAXIMUM MEDIAN AVERAGE DEVIATION
REAL-TIME 10 11.616667 0.897937 1.559093 1.044263 1.161667 0.247108
RUN-TIME 10 11.455786 0.893697 1.53499 1.033646 1.145579 0.23768
USER-RUN-TIME 10 11.347831 0.889276 1.51788 1.027216 1.134783 0.235041
SYSTEM-RUN-TIME 10 0.107904 0.004422 0.017243 0.009863 0.01079 0.004822
PAGE-FAULTS 10 0 0 0 0 0 0.0
GC-RUN-TIME 10 93.52 7.941 12.09 9.213 9.352 1.187949
BYTES-CONSED 10 4475268912 447368704 447659808 447511728 447526880.0 78758.93
EVAL-CALLS 10 0 0 0 0 0 0.0
previous version melusina-org/cl-confidence@3969b7a yields
- SAMPLES TOTAL MINIMUM MAXIMUM MEDIAN AVERAGE DEVIATION
REAL-TIME 10 45.00373 4.336514 4.688924 4.50316 4.500373 0.110217
RUN-TIME 10 44.575054 4.303421 4.656209 4.471423 4.457505 0.107461
USER-RUN-TIME 10 43.48581 4.203057 4.528108 4.343588 4.348581 0.097924
SYSTEM-RUN-TIME 10 1.08925 0.063864 0.139136 0.10037 0.108925 0.022525
PAGE-FAULTS 10 0 0 0 0 0 0.0
GC-RUN-TIME 10 3343.807 220.541 455.821 274.727 334.3807 89.76528
BYTES-CONSED 10 4341715568 430980480 459500912 431031840 434171550.0 8485350.0
EVAL-CALLS 10 0 0 0 0 0 0.0