Skip to content

Disable consistently failing tests for specific OS and Python versions to get CI running clean.#2944

Merged
d3r3kk merged 6 commits into
microsoft:masterfrom
d3r3kk:2795_disable_known_failing
Oct 23, 2018
Merged

Disable consistently failing tests for specific OS and Python versions to get CI running clean.#2944
d3r3kk merged 6 commits into
microsoft:masterfrom
d3r3kk:2795_disable_known_failing

Conversation

@d3r3kk

@d3r3kk d3r3kk commented Oct 18, 2018

Copy link
Copy Markdown

For #2795

Specific known tests are disabled for specific OS and Python version test runs only. Once the rolling-CI build runs 'green' on Azure DevOps, we can turn on warnings as errors so that the build results become meaningful.

  • Each disabled test is commented to indicate the issue that tracks it's re-enabling

  • Common test utility code moved to src/test/common.ts

  • Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR)

  • Title summarizes what is changing

  • Has a news entry file (remember to thank yourself!)

  • Unit tests & system/integration tests are added/updated

  • package-lock.json has been regenerated by running npm install (if dependencies have changed)

Comment thread src/test/autocomplete/pep526.test.ts Outdated
Comment thread src/test/autocomplete/pep526.test.ts Outdated
Comment thread src/test/common.ts Outdated
Comment thread src/test/common.ts Outdated
Comment thread src/test/common.ts Outdated
Comment thread src/test/common.ts Outdated
Comment thread src/test/common.ts Outdated
- Move common functionality out of the serviceRegistry for tests:
  - 'get python version' functionality
- Added common functionality:
  - shouldSkipForOses
  - shouldSkipForPythonVersions
- Each disabled test is tracked by an open issue
- Each disabled test has a comment indicating why
- Logic for determining equality between version specs and python version updated
- More relevant naming of test util functions
- use of SemVer for version comparison - better than strings!
@d3r3kk d3r3kk force-pushed the 2795_disable_known_failing branch from 6219d07 to 8e5e6ed Compare October 19, 2018 01:37
@d3r3kk

d3r3kk commented Oct 23, 2018

Copy link
Copy Markdown
Author

Rebuild...

@d3r3kk d3r3kk closed this Oct 23, 2018
@d3r3kk d3r3kk reopened this Oct 23, 2018
@d3r3kk d3r3kk merged commit c7e2a83 into microsoft:master Oct 23, 2018
@d3r3kk d3r3kk deleted the 2795_disable_known_failing branch October 23, 2018 19:56
@lock lock Bot locked as resolved and limited conversation to collaborators Jul 31, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants