PR nunit/nunit#5058 added support to retry tests by exception, to be released in the upcoming version 4.5 of the framework.
We should add this to the docs to increase visibility