Different solvers can handle different kinds of problems: constrained or unconstrained, support for equality constraints etc. I guess we could find a way to help filter relevant problems for a given solver, rather than trying to launch the whole Schittkowski test suite or expect the developer to go through each problem to find the ones that could work.
I guess that information could be processed by tests.cmake or Schittkowski's CMakeLists.txt to only use relevant problems.