Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
6f0b1fe
print durations
giampaolo Mar 10, 2019
2b16e57
don't print duration if not verbose
giampaolo Mar 10, 2019
49aa791
add cmdline arg (bool) to toggle durations
giampaolo Mar 10, 2019
4830509
make --durations arg accept a mandatory int value
giampaolo Mar 10, 2019
f8a49d3
print durations
giampaolo Mar 10, 2019
875e93d
hide durations < 0.000
giampaolo Mar 10, 2019
59dfc67
minor cosmetic changes
giampaolo Mar 10, 2019
c92bc24
don't use bare except clause
giampaolo Mar 10, 2019
d88087e
add a public addDuration method to TestResult
giampaolo Mar 10, 2019
1952ffa
fix TypeError occurring on skip
giampaolo Mar 10, 2019
9f308dc
Merge branch 'master' into unittest-durations
giampaolo Mar 10, 2019
226288a
fix unit tests
giampaolo Mar 11, 2019
89e915f
add a couple of tests for runner
giampaolo Mar 11, 2019
968c3af
don't add durations multiple times + write durations test
giampaolo Mar 11, 2019
a8b38e9
don't print header if there are no durations
giampaolo Mar 11, 2019
f95edc7
small refactoring
giampaolo Mar 11, 2019
9beb931
add doc
giampaolo Mar 11, 2019
86fc3f8
update doc
giampaolo Mar 11, 2019
a1f5e49
improve test
giampaolo Mar 11, 2019
9d98536
use example from stdlib
giampaolo Mar 11, 2019
7223bc9
ignore me
giampaolo Mar 11, 2019
3c4af91
merge from master
giampaolo Apr 26, 2019
3f4d638
address PR review (amongst which, show slowest tests firsts)
giampaolo Apr 26, 2019
b3bb3e0
update doc samples
giampaolo Apr 26, 2019
a93b460
fix doc syntax
giampaolo Apr 29, 2019
0a6bcbb
Merge branch 'master' into unittest-durations
giampaolo Apr 29, 2019
961ba55
merge from master
giampaolo Feb 15, 2020
d0330f6
update doc
giampaolo Feb 15, 2020
9935349
update doc
giampaolo Feb 15, 2020
f4cd001
rephrasing
giampaolo Feb 16, 2020
4471928
forgot pdb line
giampaolo Feb 16, 2020
6412439
update whatsnew
giampaolo May 26, 2020
1a9c098
update code to latest main branch
giampaolo Nov 24, 2022
c917206
updated Misc/NEWS entry
giampaolo Nov 24, 2022
5a4e21b
merge from main
giampaolo Nov 24, 2022
2ffe250
address review comments
giampaolo Nov 24, 2022
2fdfe1d
add test
giampaolo Nov 24, 2022
c0e137e
no longer print individual test durations
giampaolo Nov 24, 2022
86a094c
remove duplicated test
giampaolo Nov 24, 2022
3649013
calculate duration time after cleanup methods
giampaolo Nov 24, 2022
3217b89
reword doc / cmdline help
giampaolo Nov 24, 2022
b2b37ad
move TextRunner test in test_runner.py
giampaolo Nov 24, 2022
2b7f3dc
improve unit test
giampaolo Nov 24, 2022
cfd65b0
remove code which is no longer used
giampaolo Nov 24, 2022
4772f96
Merge branch 'main' into unittest-durations
giampaolo Nov 24, 2022
3ea0be8
Merge branch 'main' into unittest-durations
giampaolo Nov 28, 2022
19f9c4b
address @ezio-melotti code review comments
giampaolo Nov 28, 2022
ed5f317
Merge branch 'main' into unittest-durations
giampaolo Apr 2, 2023
e6d3b58
Update 3.12.rst
giampaolo Apr 2, 2023
90a3d70
Update 3.12.rst
giampaolo Apr 2, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add doc
  • Loading branch information
giampaolo committed Mar 11, 2019
commit 9beb9310958bd9c3f59563dd12beca2544c5cb97
36 changes: 31 additions & 5 deletions Doc/library/unittest.rst
Original file line number Diff line number Diff line change
Expand Up @@ -239,6 +239,10 @@ Command-line options

Show local variables in tracebacks.

.. cmdoption:: --durations

Show test durations.

.. versionadded:: 3.2
The command-line options ``-b``, ``-c`` and ``-f`` were added.

Expand All @@ -248,10 +252,12 @@ Command-line options
.. versionadded:: 3.7
The command-line option ``-k``.

.. versionadded:: 3.8
The command-line option ``--durations``.

The command line can also be used for test discovery, for running all of the
tests in a project or just a subset.


.. _unittest-test-discovery:

Test Discovery
Expand Down Expand Up @@ -1868,6 +1874,13 @@ Loading and running tests
A list containing :class:`TestCase` instances that were marked as expected
failures, but succeeded.

.. attribute:: collectedDurations

A list containing 2-tuples of :class:`TestCase` instances and floats
representing the elapsed time of each test which was run.

.. versionadded:: 3.8

.. attribute:: shouldStop

Set to ``True`` when the execution of tests should stop by :meth:`stop`.
Expand Down Expand Up @@ -2019,16 +2032,26 @@ Loading and running tests

.. versionadded:: 3.4

.. method:: addDuration(test, elapsed)

Called when the test case finishes. **elapsed** is the time represented
in seconds.

.. versionadded:: 3.8

.. class:: TextTestResult(stream, descriptions, verbosity)
.. class:: TextTestResult(stream, descriptions, verbosity, *, durations=None)

A concrete implementation of :class:`TestResult` used by the
:class:`TextTestRunner`.
Subclasses should accept ``**kwargs`` to ensure compatibility as the
interface changes.

.. versionadded:: 3.2
This class was previously named ``_TextTestResult``. The old name still
exists as an alias but is deprecated.

.. versionadded:: 3.8
Added *durations* argument.

.. data:: defaultTestLoader

Expand All @@ -2038,7 +2061,7 @@ Loading and running tests


.. class:: TextTestRunner(stream=None, descriptions=True, verbosity=1, failfast=False, \
buffer=False, resultclass=None, warnings=None, *, tb_locals=False)
buffer=False, resultclass=None, warnings=None, *, tb_locals=False, durations=None)

A basic test runner implementation that outputs results to a stream. If *stream*
is ``None``, the default, :data:`sys.stderr` is used as the output stream. This class
Expand All @@ -2059,14 +2082,17 @@ Loading and running tests
*warnings* to ``None``.

.. versionchanged:: 3.2
Added the ``warnings`` argument.
Added the *warnings* parameter.

.. versionchanged:: 3.2
The default stream is set to :data:`sys.stderr` at instantiation time rather
than import time.

.. versionchanged:: 3.5
Added the tb_locals parameter.
Added the *tb_locals* parameter.

.. versionchanged:: 3.8
Added the *durations* parameter.

.. method:: _makeResult()

Expand Down
25 changes: 25 additions & 0 deletions Doc/whatsnew/3.8.rst
Original file line number Diff line number Diff line change
Expand Up @@ -353,6 +353,25 @@ unittest
:meth:`~unittest.TestCase.setUpClass()`.
(Contributed by Lisa Roach in :issue:`24412`.)

* Added ``--durations`` command line option, showing the slowest test cases and
the elapsed time of each individual test::

python3 -m unittest test_suite --durations=3
.....
Slowest test durations
----------------------------------------------------------------------
0.051s test_process (test_suite.TestCase)
0.209s test_system (test_suite.TestCase)
0.414s test_memory (test_suite.TestCase)

(0.000 durations hidden. Use -v to show these durations.)
----------------------------------------------------------------------
Ran 122 tests in 1.385s

OK (skipped=3)

(Contributed by Giampaolo Rodola in :issue:`4080`)

venv
----

Expand Down Expand Up @@ -664,6 +683,12 @@ Changes in the Python API
:exc:`dbm.gnu.error` or :exc:`dbm.ndbm.error`) instead of :exc:`KeyError`.
(Contributed by Xiang Zhang in :issue:`33106`.)

* :class:`unittest.TextTestRunner` and :class:`unittest.TextTestResult`
constructors have a new *durations* keyword argument. Subclasses should take
this into account or accept ``**kwargs``.
Added :meth:`unittest.TestResult.addDuration` method and
:attr:`unittest.TestResult.collectedDurations` attribute.
(Contributed by Giampaolo Rodola in :issue:`4080`)

CPython bytecode changes
------------------------
Expand Down
2 changes: 2 additions & 0 deletions Lib/unittest/runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ class TextTestResult(result.TestResult):
separator2 = '-' * 70

def __init__(self, stream, descriptions, verbosity, *, durations=None):
"""Construct a TextTestResult. Subclasses should accept **kwargs
to ensure compatibility as the interface changes."""
super(TextTestResult, self).__init__(stream, descriptions, verbosity)
self.stream = stream
self.showAll = verbosity > 1
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Added ``--durations`` command line option, showing the slowest test cases
and the elapsed time of each individual test.
:class:`unittest.TextTestRunner` and :class:`unittest.TextTestResult`
constructors have a new *durations* keyword argument. Subclasses should take
this into account or accept ``**kwargs``. Added
:meth:`unittest.TestResult.addDuration` method and
:attr:`unittest.TestResult.collectedDurations` attribute. (Contributed by
Giampaolo Rodola in :issue:`4080`)