Running the Automated Test Suite¶
Prerequisites¶
Note: The automated test suite runs on Windows platform only due to its dependency on Gallio.
1. Install Gallio test framework into the default installation location. Do not change the installation location, otherwise the test suite will not run.
Running¶
1. Double click on the "RunHelloWorld.bat" script in the Tests sub-directory.
The tests will take several minutes to run; about 5-10 minutes on modern PC.
At completion, the results of all tests will be automatically displayed in Notepad. The first line shows the total number of tests, passed test, failed tests, and inconclusive/skipped tests. Similar to the following:
* Results: 116004 run, 115936 passed, 61 failed, 7 inconclusive, 12 skipped (12 pending)
Some failed tests are normal and expected because the compiler is still incomplete and a work in progress. Inconclusive or skipped tests are similar to failed tests, except these tests have been marked not to run because they would either:
- Generate too many error messages (and significantly slow down the whole test suite), or
- Crash and stop the test suite from completing.