Description
Running the specs in a random order results in multiple failed specs, depending on the order's seed.
Rubies
- 2.3.4
- 2.4.2 - appraisal will not run the entire suite regardless of errors encountered
Steps to Reproduce
- git clone, etc
bundle install
appraisal install
- add
--order random to the .rspec file
appraisal rspec
Seeds which are known to result in errors
- 19209 - Multiple KeyErrors
- 5710 - Expectation failures in config_env_spec
- 61592 - Exactly one failed test in setting the constant to use for settings
Description
Running the specs in a random order results in multiple failed specs, depending on the order's seed.
Rubies
Steps to Reproduce
bundle installappraisal install--order randomto the.rspecfileappraisal rspecSeeds which are known to result in errors