Add verify-exercises-in-docker

[keiravillekode]

This script is originally from generic-track

[keiravillekode]

We will eventually need the test runner enabled for production, see http://forum.exercism.org/t/create-new-track-for-rescript/22606/33 for an example discussion from another track.

For now, we can clone rexx-test-runner and run bin/run-tests-in-docker.sh This creates a local Docker image exercism/rexx-test-runner:latest

This local test runner image can be specified on the command line using -i

See exercism/free-pascal#36

[keiravillekode]

Note that the top level config.json has

  "files": {
    "solution": [
      "%{kebab_slug}.rexx"
    ],
    ...
    "example": [
      ".meta/example.rexx"
    ],
    ...
  },

with one solution file and one example file.

hello-world .meta/config.json needs to similarly have

  "files": {
    "solution": ["hello-world.rexx"],
    ...
    "example": [".meta/example.rexx"]
  },

with one solution file and one example file. (#151 achieves this for all exercises.)

Then we can run

bin/verify-exercises-in-docker -i exercism/rexx-test-runner:latest hello-world

[keiravillekode]

The following exercises succeed

accumulate
acronym
all-your-base
anagram
armstrong-numbers
atbash-cipher
bank-account
beer-song
binary-search
bob
collatz-conjecture
custom-set
darts
difference-of-squares
error-handling
etl
gigasecond
grade-school
grains
hamming
hello-world
high-scores
house
isbn-verifier
isogram
leap
luhn
matching-brackets
matrix
nth-prime
nucleotide-count
perfect-numbers
phone-number
protein-translation
proverb
queen-attack
raindrops
resistor-color
resistor-color-duo
resistor-color-trio
rna-transcription
roman-numerals
rotational-cipher
saddle-points
scrabble-score
secret-handshake
series
sieve
simple-cipher
space-age
strain
sublist
sum-of-multiples
transpose
triangle
twelve-days
two-fer

The following exercises fail

clock
list-ops
ocr-numbers
pangram
prime-factors
reverse-string
square-root
word-count

[keiravillekode]

If we use

• testlib: escape bashslash and name rexx-test-runner#31 keiravillekode:escape

to build exercism/rexx-test-runner:latest

and then merge (in any order)

• Omit -toplevel.rexx from solution #151 keiravillekode:no-toplevel-in-solution
• testlib: escape bashslash and name #155 keiravillekode:escape
• square-root: add missing space to check #154 keiravillekode:square-root-space
• Add verify-exercises-in-docker #150 keiravillekode:verify-exercises-in-docker

then we can successfully run
bin/verify-exercises-in-docker -i exercism/rexx-test-runner:latest
which tests all practice exercises against the test runner.

In other words, all exercises will now pass the test runner.

[keiravillekode]

cc @ajborla

[keiravillekode]

Now updated to allow for mismatch in number of files.

For example, with

  "files": {
    "solution": ["hello-world.rexx", "hello-world-toplevel.rexx"],
    "test": ["test-hello-world"],
    "example": [".meta/example.rexx"]
  },

we overwrite hello-world.rexx with .meta/example.rexx, and leave hello-world-toplevel.rexx unchanged.

bin/verify-exercises-in-docker -i exercism/rexx-test-runner:latest

now passes even without PR 151.

[IsaacG]

+cc @ajborla

[IsaacG]

@ajborla Thanks for taking a look! There's a few more PRs in this repo that could use your maintainer-review :)

[ajborla]

I haven't been active online for quite a while, now. I will try. I really do want to finish the project and get it live. Many thanks to you guys for keeping this going.

[IsaacG]

An occasional check on the open PRs would be helpful. No one else can make any progress without the maintainer (you) approving the PRs.