Weird result with Matrix determinant
03-17-2015, 08:16 PM (This post was last modified: 03-17-2015 08:16 PM by Tugdual.)
Post: #1
 Tugdual Senior Member Posts: 764 Joined: Dec 2013
Weird result with Matrix determinant
I wanted to calculate the determinant of the matrix
$$\begin{pmatrix} 1 & 0 & 2 & 8 \\ -2 & 1 & 1 & 5 \\ 6 & 3 & 5 & -4 \\ 10 & 4 & 3 & 0 \end{pmatrix}$$
Using Standard number format,
Prime Home says -647,000000002
Prime CAS says -647

Home is pretty close but what kind of algorithm can produce such a funny result to calculate a determinant with only integers?

Other question is: do we have an explanation for Floating and Rounded Number Formats? Those are recent additions not documented in the user guide.
 « Next Oldest | Next Newest »

 Messages In This Thread Weird result with Matrix determinant - Tugdual - 03-17-2015 08:16 PM RE: Weird result with Matrix determinant - Damien - 03-17-2015, 10:09 PM RE: Weird result with Matrix determinant - Dieter - 03-17-2015, 11:29 PM RE: Weird result with Matrix determinant - Tugdual - 03-18-2015, 08:47 PM

User(s) browsing this thread: 1 Guest(s)