Post Reply 
Accuracy and the power function
02-16-2014, 05:45 PM
Post: #3
RE: Accuracy and the power function
(02-16-2014 03:11 PM)Joe Horn Wrote:  The middle example contains an extraneous digit near the end.
Right. Has been corrected now.

Quote:On the HP 50g, the errors on these calculations are 1 ULP, -1 ULP, and -4 ULP, respectively.
Same here on a 35s and on the 39G emulator. Hm, 4 ULP in a simple standard function. I admit I would not have expected an error that large. Not in an HP.

Dieter
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Accuracy and the power function - Dieter - 02-16-2014, 02:43 PM
RE: Accuracy and the power function - Dieter - 02-16-2014 05:45 PM



User(s) browsing this thread: 1 Guest(s)