Post Reply 
WP34s: Domain Error in RMDR and MOD
10-22-2015, 09:57 PM
Post: #4
RE: WP34s: Domain Error in RMDR and MOD
Mod uses 450 digits internally.
Modulo reduction by two pi for the trig functions uses 820.

So in double precision, neither is adequate to support the entire range.


Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: WP34s: Domain Error in RMDR and MOD - Paul Dale - 10-22-2015 09:57 PM



User(s) browsing this thread: 1 Guest(s)