Base converter with fractions?
|
01-28-2017, 03:25 AM
Post: #9
|
|||
|
|||
RE: Base converter with fractions?
Thanks, Han! Great program!
(01-27-2017 05:00 AM)Han Wrote:(01-26-2017 05:18 PM)Joe Horn Wrote: Unfortunately that amount of initial roundoff introduces a great amount of error. Smith's BASECALC converts 3.142 (decimal) to "3.06646410512335" (base 7), which it converts cleanly back to what we started with, namely 3.142 (decimal), whereas "3.0665" (base 7) converts to 3.1420241566 (decimal), which is not what we started with. That's correct. BASECALC uses ordinary floating-point reals for base 10 numbers, which in RPL means that they are rounded to 12 significant digits. <0|ΙΈ|0> -Joe- |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)