HP Forums

I noticed that the manual for the CASIO fx-CG50 states that the accuracy of calculations utilizing Python differs from that of the calculator. How it differs was not stated. Does anyone on the forum know?

I think the MicroPython port uses IEEE-754 double precision binary format.

Here's an example calculation:

Code:

>>>1.0000000000000002-1

2.22044604925031e-16

(The given result is 2^-52)

lrdheat

ijabbott