Skip to content

CI test_script.py does nothing #194

@Tomaqa

Description

@Tomaqa

I believe this generally applies to multiple cases, but I will stick to one concrete submission of mine.

Following submission PR #176, I got suspicious that the CI test scripts do not run the solver on actual benchmarks.
When I tracked down the generated script, it turned out that it does not do anything at all.

The job related to the PR:
https://github.com/SMT-COMP/smt-comp.github.io/actions/runs/15822493191/job/44594752384?pr=176

The script generated by the job:
https://github.com/SMT-COMP/smt-comp.github.io/actions/runs/15822493191/artifacts/3382181727

test_script.py:

from test_solver import *
init_test()

print("Testing provers")
print('OpenSMT (min-ucore)')
end()

init_test just changes the working directory, and end exits.
Am I missing something?

I do not necessarily require this to be fixed in the CI, but I need to check if the commands of my submissions specified in the JSON config files do what I intended.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions