Base converter with fractions?
|
01-27-2017, 05:00 AM
Post: #8
|
|||
|
|||
RE: Base converter with fractions?
(01-26-2017 05:18 PM)Joe Horn Wrote: Unfortunately that amount of initial roundoff introduces a great amount of error. Smith's BASECALC converts 3.142 (decimal) to "3.06646410512335" (base 7), which it converts cleanly back to what we started with, namely 3.142 (decimal), whereas "3.0665" (base 7) converts to 3.1420241566 (decimal), which is not what we started with. It appears that the back-conversion to 3.142 is only "clean" due to rounding (limited number of significant digits). Graph 3D | QPI | SolveSys |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)