HP 42S Version Speed Variation
|
06-13-2014, 05:20 AM
Post: #49
|
|||
|
|||
RE: HP 42S Version Speed Variation
(06-13-2014 04:55 AM)Paul Dale Wrote:(06-13-2014 04:23 AM)Mike Morrow Wrote: The amount that the end result varies from a perfect 2500.0000000 is a benchmark for accuracy. heh heh! My brain hurts! In a "perfect" world with perfect infinite precision calculators, little details like floating point arithmetic would vanish or be banished. For now...let's just use truncation and rounding to get that perfect (looking) result! :-) |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)