TI59 Diagnostic forensics

[rprosperi]

(07-28-2020 05:43 PM)Pjwum Wrote:  

(07-27-2020 09:51 PM)rprosperi Wrote:  The 67 returns 1.2692E-04.

Not surprisingly, the error comes from the first pair of terms (REC(POL(theta,r)).

I used DEG mode and all the actual functions as built in the 67 (so, e.g. I used [3] [X^2] rather than [3] [ENTER] [*] ).

Is 1.2692E-04 already the result after multiplication by 1E10? I ask because this would imply an internal precision of 18 digits for the HP.

I'm not sure which multiplication by 1E10 you are referring to.

See the post just above to see the exact keystrokes and when this value appears.

Actually of course after POL(REC(30,5)), X contains 30.00012692.

I believe the 67 uses 15 internal digits, as do all Woodstocks.