TI59 Diagnostic forensics

[Pjwum]

(07-28-2020 07:01 PM)rprosperi Wrote:  [Actually of course after POL(REC(30,5)), X contains 30.00012692.

I believe the 67 uses 15 internal digits, as do all Woodstocks.

Actually the TI diagnostic programme multiplies the result of your keystroke listing by 1E10 before testing it. See my first post, 2nd inequality. Thus the 67 would output 1.2692E6 versus 0.7 with the 59.

Wow! I just checked again, result is -0.7 after multiplication with 1E10. The programme precisely tests if integer(error x 1E10)=0, thus taking the absolute error value.