error in emulator

04232016, 06:10 AM
Post: #5




RE: error in emulator
(04232016 02:24 AM)SalivationArmy Wrote: I entered 3*sqrt3*sqrt3 and got an answer of 9.00000000001 This answer is not funny, it's simply correct. Like any other finiteprecision calculator the Prime does not return sqrt 3. It returns a value that matches sqrt 3 in its first twelve digits, i.e. 1,73205080757. But that's not sqrt 3 = 1,7320508075688772935274463415... etc. etc. Now the Prime gives the exact answer based on this approximation of sqrt 3: 3 x 1,73205080757 = 5,19615242271 5,19615242271 x 1,73205080757 = 9,0000000000116675... Which, rounded to 12 digits, is the result you see (9,00000000001). Try sqrt 7 x sqrt 7 or sqrt 8 x sqrt 8. If your calculator works correctly you should not get 7 and 8 but 6,99999999998 and 8,00000000002. Dieter 

« Next Oldest  Next Newest »

Messages In This Thread 
error in emulator  SalivationArmy  04232016, 02:24 AM
RE: error in emulator  Anderson Costa  04232016, 03:10 AM
RE: error in emulator  Steve Simpkin  04232016, 04:20 AM
RE: error in emulator  SalivationArmy  04232016, 05:49 AM
RE: error in emulator  Dieter  04232016 06:10 AM

User(s) browsing this thread: 1 Guest(s)