Accuracy and the power function

02232014, 09:06 PM
Post: #16




RE: Accuracy and the power function
(02232014 02:19 PM)Dieter Wrote: I see. So this sticky bit avoids some errors caused by simple truncation. No, it is necessary to implement round to even. It allows to know whether you're in the 'halfway' situation, where the lost digits are exactly 500. The 10/13 calculators (41,15) did not implement roundtoeven, but simple round up (well 'away from zero'). Whether the lost digits are 500 or 500+ makes no difference there, see Tomas' examples. I know nothing of the accuracy of the 15digit functions I'm afraid. Werner 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)