NumWorks open source calculator
|
09-06-2017, 05:59 PM
Post: #41
|
|||
|
|||
RE: NumWorks open source calculator
The calculator forensics calculation returns 8.966758 (for 9 degrees) on this device and it seems to always display results to 7 significant figures. Calculation precision seems therefore to be on the low side.
Is it perhaps squandering higher levels of precision by carrying forward rounded up/down display values rather than underlying register values? |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 2 Guest(s)