error in emulator
04-23-2016, 06:10 AM
Post: #5
 Dieter Senior Member Posts: 2,397 Joined: Dec 2013
RE: error in emulator
(04-23-2016 02:24 AM)SalivationArmy Wrote:  I entered 3*sqrt3*sqrt3 and got an answer of 9.00000000001
does the real Prime make this same funny answer?

This answer is not funny, it's simply correct.

Like any other finite-precision calculator the Prime does not return sqrt 3. It returns a value that matches sqrt 3 in its first twelve digits, i.e. 1,73205080757.
But that's not sqrt 3 = 1,7320508075688772935274463415... etc. etc.

Now the Prime gives the exact answer based on this approximation of sqrt 3:

3 x 1,73205080757 = 5,19615242271
5,19615242271 x 1,73205080757 = 9,0000000000116675...

Which, rounded to 12 digits, is the result you see (9,00000000001).

Try sqrt 7 x sqrt 7 or sqrt 8 x sqrt 8. If your calculator works correctly you should not get 7 and 8 but 6,99999999998 and 8,00000000002.

Dieter
 « Next Oldest | Next Newest »

 Messages In This Thread error in emulator - SalivationArmy - 04-23-2016, 02:24 AM RE: error in emulator - Anderson Costa - 04-23-2016, 03:10 AM RE: error in emulator - Steve Simpkin - 04-23-2016, 04:20 AM RE: error in emulator - SalivationArmy - 04-23-2016, 05:49 AM RE: error in emulator - Dieter - 04-23-2016 06:10 AM

User(s) browsing this thread: 1 Guest(s)