Fix eval e2e test

[zhenchaoni]

Fixes #826

1. Skip some e2e tests for vitisai because the related model isn't supported in vitisai
2. Loose some metric assertion logic. Because we only eval with 10 samples in e2e, so the evaluated metric has big value range, so loose it to make the test more stable. More accurate evaluation will be done in our model evaluation work.