Post Reply 
CASIO fx-G50 Python
10-06-2021, 10:07 PM
Post: #2
RE: CASIO fx-G50 Python
I think the MicroPython port uses IEEE-754 double precision binary format.

Here's an example calculation:
Code:
>>>1.0000000000000002-1
2.22044604925031e-16
(The given result is 2^-52)

— Ian Abbott
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
CASIO fx-G50 Python - lrdheat - 10-06-2021, 09:07 PM
RE: CASIO fx-G50 Python - ijabbott - 10-06-2021 10:07 PM



User(s) browsing this thread: 1 Guest(s)