HP41: accuracy of 13digit routines

09022015, 10:18 AM
Post: #4




RE: HP41: accuracy of 13digit routines
(09022015 04:45 AM)Thomas Klemm Wrote: Thus the internal 13digit result isn't rounded correctly but cut off. (09022015 06:11 AM)Joe Horn Wrote: Thomas is correct. Thank you very much. So the 13digit routines truncate after 13 digits. I assume this also applies to the transcendental functions (log, exp, trig etc.). Now if I set a WP34s to RM 4 (truncate) and apply a RSD 13 to every result, this should yield the same result as the 41's 13digit routines? The reason I'm asking this is testing a Lanczos Gamma approximation with an optimized coefficient set, cf. the recent thread in the HP41 software library. Dieter 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)