Skip to content

run tests in parallel by equally dividing them between workers#8774

Merged
vladima merged 4 commits into
masterfrom
parallel-tests
May 27, 2016
Merged

run tests in parallel by equally dividing them between workers#8774
vladima merged 4 commits into
masterfrom
parallel-tests

Conversation

@vladima
Copy link
Copy Markdown
Contributor

@vladima vladima commented May 23, 2016

difference from current implementation of runtests-parallel: instead of partitioning statically on per-category basis we first load a list of tests and equally divide every category based on the number of workers (by default is set to require("os").cpus().length).
Running times (with lint=false) on Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz, RAM 16 GB:

  • jake runtests lint=false - 5m45.681s
  • jake runtests-parallel lint=false - 1m42.367s

Comment thread Jakefile.js Outdated
complete();
});
lint.invoke();
if (i === 0) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't need this check for the non-parallel version

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure

Comment thread src/harness/runnerbase.ts

type TestRunnerKind = CompilerTestKind | FourslashTestKind | "project" | "rwc" | "test262";
type CompilerTestKind = "conformance" | "compiler";
type FourslashTestKind = "fourslash" | "fourslash-shims" | "fourslash-shims-pp" | "fourslash-server";
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these don't need to be in order? That's strange

@sandersn
Copy link
Copy Markdown
Member

👍

Comment thread Jakefile.js Outdated

}
else {
// run task to load all tests and partition then between workers
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: partition them

@mhegazy
Copy link
Copy Markdown
Contributor

mhegazy commented May 26, 2016

👍

@vladima vladima merged commit f07b4ba into master May 27, 2016
@vladima vladima deleted the parallel-tests branch May 27, 2016 17:38
@microsoft microsoft locked and limited conversation to collaborators Jun 19, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants