Post Reply 
HP calcs are really not that accurate..
12-15-2017, 03:28 PM
Post: #65
RE: HP calcs are really not that accurate..
So, I've come to the conclusion that 34 significant digits should be OK.

My just arrived and unboxed DM42 were given the SQRT2 "torture test" with 10 SQRT's and squared back.
Display showing "2" as answer, though doing a "2 -" command resulted in "-2,8E-32.
I'm happy with that, and my Asperger/ADD have got peace of mind Smile

Esben
28s, 35s, 49G+, 50G, Prime G2 HW D, SwissMicros DM42, DM32, WP43 Pilot
Elektronika MK-52 & MK-61
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: HP calcs are really not that accurate.. - DA74254 - 12-15-2017 03:28 PM



User(s) browsing this thread: 1 Guest(s)