Skip to content

Misc improvements to the float tutorial #102052

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rhettinger merged 10 commits into from
Feb 19, 2023
Merged

Misc improvements to the float tutorial #102052

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
1e2ec34
Example is more intelligible without the leading zeros
rhettinger Feb 19, 2023
082d7a8
Leading zeros are easier to read and match the surrounding text.
rhettinger Feb 19, 2023
2ff520d
Compare sum() to straight addition and to math.fsum()
rhettinger Feb 19, 2023
22e1a96
Show math.isclose() for comparing inexact values
rhettinger Feb 19, 2023
cb1f78a
Add doctests throughout
rhettinger Feb 19, 2023
e9e959a
Add a more useful example of round() for comparisons
rhettinger Feb 19, 2023
8f02dc5
Shorter example
rhettinger Feb 19, 2023
d8bcc4c
Fix doctests: Missing import and counterfactual example.
rhettinger Feb 19, 2023
cd8abc5
Compare sum() and fsum() with straight addition
rhettinger Feb 19, 2023
d6a6b6b
Add section author
rhettinger Feb 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Compare sum() and fsum() with straight addition
  • Loading branch information
@rhettinger
rhettinger committed Feb 19, 2023
commit cd8abc516370508654387097cafeb1032e3eed38
6 changes: 6 additions & 0 deletions Doc/tutorial/floatingpoint.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -245,6 +245,12 @@ each other out leaving a final sum near zero:
8.042173697819788e-13
>>> sum(arr) # Multiple roundings in extended precision
8.042178034628478e-13
>>> total = 0.0
>>> for x in arr:
... total += x # Multiple roundings in standard precision
...
>>> total # Straight addition has no correct digits!
-0.0051575902860057365


.. _tut-fp-error:
Expand Down