Skip to content

🤖 Add average test runner run time to config.json#1937

Merged
iHiD merged 1 commit into
exercism:mainfrom
ErikSchierboom:add-average-run-time
May 14, 2021
Merged

🤖 Add average test runner run time to config.json#1937
iHiD merged 1 commit into
exercism:mainfrom
ErikSchierboom:add-average-run-time

Conversation

@ErikSchierboom
Copy link
Copy Markdown
Member

We will auto-merge this PR shortly. No action is required


This PR adds a new test_runner.average_run_time key to the config.json file. The purpose of this field is allow the website to show a progress bar while the test runner runs. The average run time is defined in seconds with one digit of precision.

For more information, see exercism/docs#130

We've pre-populated the average run time value by timing the execution time of the test runner in Docker on the example solution of the leap exercise, repeating that 4 more times, and then averaging the execution times. Clearly, the actual average execution time will differ between exercises and solutions, so this should be seen as very general indicator.

This is mostly a stop-gap solution for now. We'll revisit this in 6 months time or so.

Tracking

exercism/v3-launch#35

This commit adds a new `test_runner.average_run_time` key to the `config.json` file. The purpose of this field is allow the website to show a progress bar while the test runner runs. The average run time is defined in seconds with one digit of precision. Its value has been populated by timing the execution time of running the test runner in Docker on one of the track's practice exercise. Clearly, the execution time will differ between exercises and between solutions, so this should be seen as a general indicator.
@ErikSchierboom ErikSchierboom added the v3-migration 🤖 Preparing for Exercism v3 label May 12, 2021
@iHiD iHiD merged commit d19b2cd into exercism:main May 14, 2021
ErikSchierboom added a commit to ErikSchierboom/java that referenced this pull request May 19, 2021
This commit adds a new `test_runner.average_run_time` key to the `config.json` file. The purpose of this field is allow the website to show a progress bar while the test runner runs. The average run time is defined in seconds with one digit of precision. Its value has been populated by timing the execution time of running the test runner in Docker on one of the track's practice exercise. Clearly, the execution time will differ between exercises and between solutions, so this should be seen as a general indicator.
ErikSchierboom added a commit to ErikSchierboom/java that referenced this pull request May 20, 2021
This commit adds a new `test_runner.average_run_time` key to the `config.json` file. The purpose of this field is allow the website to show a progress bar while the test runner runs. The average run time is defined in seconds with one digit of precision. Its value has been populated by timing the execution time of running the test runner in Docker on one of the track's practice exercise. Clearly, the execution time will differ between exercises and between solutions, so this should be seen as a general indicator.
@ErikSchierboom ErikSchierboom added the x:size/tiny Tiny amount of work label Oct 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

v3-migration 🤖 Preparing for Exercism v3 x:size/tiny Tiny amount of work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants