Skip to content

gh-74902: add unicode grapheme cluster break algorithm #2673

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Vermeille wants to merge 13 commits into from
+3,784 −3,033
Closed

gh-74902: add unicode grapheme cluster break algorithm #2673

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
b79f969
add unicodedata.grapheme_cluster_break()
Vermeille Jul 11, 2017
c9a4211
generate unicodedata.c.h with clinic
Vermeille Jul 13, 2017
7f56b78
patchcheck
Vermeille Jul 13, 2017
a47de54
add the grapheme cluster break automaton
Vermeille Jul 13, 2017
c152171
add my name to Misc/ACKS
Vermeille Jul 14, 2017
b103be7
code review fixes
Vermeille Aug 3, 2017
c9848e2
rename break_graphemes to iter_graphemes
Vermeille Aug 3, 2017
2dee91e
make GraphemeClusterIterator a GC type
Vermeille Aug 3, 2017
a5b3c10
allow iterating only over a range of indices
Vermeille Jan 10, 2018
ba1e9b7
Merge branch 'main' into grapheme_cluster_break
serhiy-storchaka Dec 17, 2025
ae06154
Add some tests.
serhiy-storchaka Dec 17, 2025
1965ed6
Save Grapheme_Cluster_Break for unassigned code points.
serhiy-storchaka Dec 17, 2025
164d19b
Make "Any" the first entry.
serhiy-storchaka Dec 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
generate unicodedata.c.h with clinic
  • Loading branch information
@Vermeille
Vermeille committed Jul 13, 2017
commit c9a421110845ecb38c97c689008711ce50f913b4
7 changes: 3 additions & 4 deletions Modules/clinic/unicodedata.c.h
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions Modules/unicodedata.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -390,12 +390,12 @@ unicodedata.UCD.grapheme_cluster_break
chr: int(accept={str})
/

Returns the east asian width assigned to the character chr as string.
Returns the GraphemeBreakProperty assigned to the character chr as string.
[clinic start generated code]*/

static PyObject *
unicodedata_UCD_grapheme_cluster_break_impl(PyObject *self, int chr)
/*[clinic end generated code: output=484e8537d9ee8197 input=c4854798aab026e0]*/
/*[clinic end generated code: output=7c8f206a79cc1cd8 input=81f5a87218f8439e]*/
{
int index;
Py_UCS4 c = (Py_UCS4)chr;
Expand Down