Base converter with fractions?

01282017, 03:25 AM
Post: #9




RE: Base converter with fractions?
Thanks, Han! Great program!
(01272017 05:00 AM)Han Wrote:(01262017 05:18 PM)Joe Horn Wrote: Unfortunately that amount of initial roundoff introduces a great amount of error. Smith's BASECALC converts 3.142 (decimal) to "3.06646410512335" (base 7), which it converts cleanly back to what we started with, namely 3.142 (decimal), whereas "3.0665" (base 7) converts to 3.1420241566 (decimal), which is not what we started with. That's correct. BASECALC uses ordinary floatingpoint reals for base 10 numbers, which in RPL means that they are rounded to 12 significant digits. <0ΙΈ0> Joe 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)