Post Reply 
WP 34S conversion error
10-10-2014, 05:57 AM
Post: #4
RE: WP 34S conversion error
(10-09-2014 09:37 PM)Paul Dale Wrote:  As is documented in the manual, the 34S uses the NIST definitions for units where ever possible:
http://physics.nist.gov/Pubs/SP811/appenB9.html#LENGTH

Unless printed in bold, the values on that page are generally rounded to seven significant digits. So they are "close enough" but not exact. I think the 34s constants should not be limited in that way, if a more exact value is available.

Dieter
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
WP 34S conversion error - Peter Van Roy - 10-09-2014, 06:01 PM
RE: WP 34S conversion error - Paul Dale - 10-09-2014, 09:37 PM
RE: WP 34S conversion error - walter b - 10-10-2014, 08:27 AM
RE: WP 34S conversion error - Dieter - 10-10-2014 05:57 AM
RE: WP 34S conversion error - walter b - 10-10-2014, 08:23 AM
RE: WP 34S conversion error - Dieter - 10-10-2014, 07:04 PM
RE: WP 34S conversion error - walter b - 10-10-2014, 07:44 PM
RE: WP 34S conversion error - walter b - 12-09-2014, 07:03 AM
RE: WP 34S conversion error - walter b - 01-05-2015, 08:13 PM
RE: WP 34S conversion error - Dieter - 01-07-2015, 07:34 PM
RE: WP 34S conversion error - Wolfgang - 11-11-2014, 10:30 PM



User(s) browsing this thread: 2 Guest(s)