Pioneer vs RPL precision

[Marco Polo]

(06-08-2022 05:12 AM)Marco Polo Wrote:  Using FIX 5 i expect to see 5 decimals.
The number is rounded for any FIX value,
In the specific case the calculators gives a "wrong" information, displaying a rounded (to zero decimals) number instead the expected five decimals.
I am not a mathematician nor an expert of calculators principles, so I may be wrong, but as an engineer I find this behavior quite disturbing.
Strangely, I never noted it since 1989....

Just tested on Plus42, set to "ALL" decimals.
It displays "10" but SHOW displays 9.999999999......

My understanding, now, is that hystorically the calculator design was aimed to display results in a "confortable" way for most people, hiding were possible the rounding errors and HP choosed the way to "hide" rounding errors only when FIXing the decimals.
If my understanding is correct, i can live with it :-)