HP Forum Archive 21

[ Return to Index | Top of Index ]

HP Prime: Rounding error in determinant Message #1 Posted by Stephan Matthys on 25 Oct 2013, 8:49 a.m. Let's assume the following matrix: [[4 5 7] [8 9 0] [5 6 2]] The determinant (as given by my Prime (hardware & emulator, both running version 2013 8 13. Rev:5016)) is 13. The transposed matrix is: [[4 8 5] [5 9 6] [7 0 2]] The corresponding determinant is 13.0000000002 Why? Shouldn't they be the same? btw: my HP15C also makes a small error (-2e-8) in the determinant of the transposed matrix...

Re: HP Prime: Rounding error in determinant Message #2 Posted by Eddie W. Shore on 25 Oct 2013, 9:38 a.m., in response to message #1 by Stephan Matthys Short Answer: Floating Point Computations (I think)

Re: HP Prime: Rounding error in determinant Message #3 Posted by Gilles Carpentier on 25 Oct 2013, 7:14 p.m., in response to message #1 by Stephan Matthys Hi In CAS mode you will get the same and exact result. Probably some rounding effect in HOME By the way the HP50 give 13 both in exact and approx mode Edited: 25 Oct 2013, 7:16 p.m.

Re: HP Prime: Rounding error in determinant Message #4 Posted by Walter B on 25 Oct 2013, 9:29 p.m., in response to message #1 by Stephan Matthys FWIW, the WP 34S returns exact 13 for both the original and its transposed. d:-)

[ Return to Index | Top of Index ]

Go back to the main exhibit hall