Skip to content

gh-129107: make bytearrayiter free-threading safe #130096

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kumaraditya303 merged 12 commits into from
Feb 19, 2025
Merged

gh-129107: make bytearrayiter free-threading safe #130096

Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
cac384d
gh-129107: make bytearrayiter free-threading safe
tom-pytel Feb 13, 2025
4626f8f
📜🤖 Added by blurb_it.
blurb-it[bot] Feb 13, 2025
518d5c5
remove unnecessary critical sections
tom-pytel Feb 13, 2025
8a1edd8
misc cleanup
tom-pytel Feb 14, 2025
1069a64
atomic PyByteArray_GET_SIZE
tom-pytel Feb 14, 2025
185e2f1
use support.Py_GIL_DISABLED
tom-pytel Feb 14, 2025
cfa80bb
Merge branch 'main' into fix-issue-129107-iterator
tom-pytel Feb 15, 2025
6e15abd
restore bytearrayiter_next critical section
tom-pytel Feb 15, 2025
82ee657
Update Misc/NEWS.d/next/Core_and_Builtins/2025-02-13-20-42-53.gh-issu…
tom-pytel Feb 18, 2025
db66626
requested changes
tom-pytel Feb 18, 2025
b41ca85
requested changes
tom-pytel Feb 18, 2025
095e20e
test iter_reduce and iter_setstate
tom-pytel Feb 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
test iter_reduce and iter_setstate
  • Loading branch information
@tom-pytel
tom-pytel committed Feb 18, 2025
commit 095e20e8aa7cf8b346c4231bc3c12b7a6461670e
12 changes: 11 additions & 1 deletion Lib/test/test_bytes.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2521,12 +2521,20 @@ def check(funcs, a=None, *args):
@threading_helper.requires_working_threading()
def test_free_threading_bytearrayiter(self):
# Non-deterministic but good chance to fail if bytearrayiter is not free-threading safe.
# We are fishing for a "Assertion failed: object has negative ref count".
# We are fishing for a "Assertion failed: object has negative ref count" and tsan races.

def iter_next(b, it):
b.wait()
list(it)

Comment thread
tom-pytel marked this conversation as resolved.
def iter_reduce(b, it):
b.wait()
it.__reduce__()

def iter_setstate(b, it):
b.wait()
it.__setstate__(0)

def check(funcs, it):
barrier = threading.Barrier(len(funcs))
threads = []
Expand All @@ -2543,6 +2551,8 @@ def check(funcs, it):
ba = bytearray(b'0' * 0x4000) # this is a load-bearing variable, do not remove

check([iter_next] * 10, iter(ba))
check([iter_next] + [iter_reduce] * 10, iter(ba)) # for tsan
check([iter_next] + [iter_setstate] * 10, iter(ba)) # for tsan


if __name__ == "__main__":
Expand Down