Skip to content

bpo-25872: Add unit tests for linecache and threading #25913

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
iritkatriel merged 21 commits into from
May 18, 2021
Merged

bpo-25872: Add unit tests for linecache and threading #25913

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
5143e74
bpo-25872: add test_oserror
uniocto May 5, 2021
fc1f92d
refactor linecache
uniocto May 5, 2021
fc4df5d
add test_multithread_modify_file()
uniocto May 5, 2021
a977922
refactor test_threading
uniocto May 5, 2021
759de2b
refactor test_multithread_modify_file_noerror()
uniocto May 5, 2021
5666a1d
refactor raise_oserror()
uniocto May 5, 2021
4513859
Change black box tests and refactoring
uniocto May 8, 2021
8376d21
refactor LineCacheInvalidationTests
uniocto May 9, 2021
708e348
refactor test_multithread_modify_file_noerror
uniocto May 9, 2021
f021de2
refactor assertions
uniocto May 9, 2021
a396fad
Update Lib/test/test_linecache.py
uniocto May 9, 2021
833c9b9
Update Lib/test/test_linecache.py
uniocto May 9, 2021
bcc20ab
Update Lib/test/test_threading.py
uniocto May 9, 2021
ba62b83
change __file__ and rm traceback.format_stack
uniocto May 13, 2021
420a638
add traceback
uniocto May 13, 2021
2c8269b
fix type in field name
iritkatriel May 14, 2021
8efe040
reduce repetition in setUp
iritkatriel May 14, 2021
240eb9a
check cache keys directly, not count
iritkatriel May 14, 2021
f66a050
Merge pull request #2 from iritkatriel/pr25913
uniocto May 15, 2021
78897e7
addCleanup to outside of the mofidy_file()
uniocto May 15, 2021
ac550ef
Merge remote-tracking branch 'upstream/main' into fix-issue-25872
uniocto May 17, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 43 additions & 0 deletions Lib/test/test_linecache.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -239,5 +239,48 @@ def raise_memoryerror(*args, **kwargs):
self.assertEqual(linecache.getlines(FILENAME), lines)


class LineCacheInvalidationTests(unittest.TestCase):
def setUp(self):
super().setUp()
linecache.clearcache()
self.deleted_file = os_helper.TESTFN + '.1'
self.modified_file = os_helper.TESTFN + '.2'
self.unchange_file = os_helper.TESTFN + '.3'
self.addCleanup(os_helper.unlink, self.deleted_file)
self.addCleanup(os_helper.unlink, self.modified_file)
self.addCleanup(os_helper.unlink, self.unchange_file)
with open(self.deleted_file, 'w', encoding='utf-8') as source:
source.write('print("will be deleted")')
with open(self.modified_file, 'w', encoding='utf-8') as source:
source.write('print("will be modified")')
with open(self.unchange_file, 'w', encoding='utf-8') as source:
source.write('print("unchange")')

linecache.getlines(self.deleted_file)
linecache.getlines(self.modified_file)
linecache.getlines(self.unchange_file)

os.remove(self.deleted_file)
with open(self.modified_file, 'w', encoding='utf-8') as source:
source.write('print("was modified")')

def test_checkcache_with_oserror(self):
Comment thread
uniocto marked this conversation as resolved.
Outdated
self.assertEqual(3, len(linecache.cache.keys()))
linecache.checkcache(self.deleted_file)
self.assertTrue(2 == len(linecache.cache.keys()) and
self.deleted_file not in linecache.cache.keys())
Copy link
Copy Markdown
Member

@iritkatriel iritkatriel May 9, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Break this up into assertEqual and assertNotIn. See the assert methods here: https://docs.python.org/3/library/unittest.html

That way we get better error messages in the output when the assertion fails.


def test_checkcache_with_not_match_size_or_timestamp(self):
Comment thread
uniocto marked this conversation as resolved.
Outdated
self.assertEqual(3, len(linecache.cache.keys()))
linecache.checkcache(self.modified_file)
self.assertTrue(2 == len(linecache.cache.keys()) and
self.modified_file not in linecache.cache.keys())

def test_checkcache_with_no_parameters(self):
self.assertEqual(3, len(linecache.cache.keys()))
linecache.checkcache()
self.assertTrue([self.unchange_file] == list(linecache.cache.keys()))
Copy link
Copy Markdown
Member

@iritkatriel iritkatriel May 9, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

assertEqual



if __name__ == "__main__":
unittest.main()
19 changes: 19 additions & 0 deletions Lib/test/test_threading.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@
import subprocess
import signal
import textwrap
import traceback

from unittest import mock
from test import lock_tests
Expand Down Expand Up @@ -1338,6 +1339,24 @@ def run(self):
# explicitly break the reference cycle to not leak a dangling thread
thread.exc = None

def test_multithread_modify_file_noerror(self):
Comment thread
uniocto marked this conversation as resolved.
def modify_file():
with open(__file__, 'a') as fp:
Comment thread
iritkatriel marked this conversation as resolved.
Outdated
fp.write(' ')
Comment thread
iritkatriel marked this conversation as resolved.
traceback.format_stack()

threads = [
threading.Thread(target=modify_file)
for i in range(100)
]
try:
Copy link
Copy Markdown
Member

@iritkatriel iritkatriel May 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which exceptions are you trying to ignore here?

Copy link
Copy Markdown
Contributor Author

@uniocto uniocto May 9, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing, sorry. I removed try.

for t in threads:
t.start()
for t in threads:
t.join()
Copy link
Copy Markdown
Member

@iritkatriel iritkatriel May 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a reason why you don't do

for t in threads:
    t.start()
    t.join()

?

Copy link
Copy Markdown
Contributor Author

@uniocto uniocto May 9, 2021 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing, sorry.
So I fixed it to your feedback.

finally:
pass


class ThreadRunFail(threading.Thread):
def run(self):
Expand Down