Base converter with fractions?

01272017, 05:00 AM
Post: #8




RE: Base converter with fractions?
(01262017 05:18 PM)Joe Horn Wrote: Unfortunately that amount of initial roundoff introduces a great amount of error. Smith's BASECALC converts 3.142 (decimal) to "3.06646410512335" (base 7), which it converts cleanly back to what we started with, namely 3.142 (decimal), whereas "3.0665" (base 7) converts to 3.1420241566 (decimal), which is not what we started with. It appears that the backconversion to 3.142 is only "clean" due to rounding (limited number of significant digits). Graph 3D  QPI  SolveSys 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)