[WP34s] Unexpected results in fraction mode

[Dieter]

(06-11-2014 06:14 PM)Joe Horn Wrote:  For reference only, here's what the Prime's fraction button yields in Home view (rev 6030 only):

FIX 11 mode: 400,000,000,001 / 66,666,666,667 (or 5 + 66,666,666,666 / 66,666,666,667).
This is the simplest fraction that rounds to 5.99999999999.

Here we see what can be done with sufficiently large denominators. ;-) The usual midrange calculators as well as the 34s are limited to values like 4095 or 9999.

Quote:I think Prime is the only calculator in the world that finds this result, due to its superior fraction algorithm.

I suppose it's simply the larger denominator. <8)

Quote:STD or FIX 10 (or less): 6.
As expected.

Now that's an interesting point. Do the Prime's results in fraction mode depend on the display setting? This would make some sense ("show the best fraction that agrees with X rounded to four places").

Dieter