Post Reply 
HP Prime complex division problem in CAS
11-20-2020, 04:55 PM
Post: #7
RE: HP Prime complex division problem in CAS
CAS is designed for exact computations, not approx : I mean z1/z2 is computed as z1*conj(z2)/norm(z2)^2, and that's the reason why it will overflow with large values (by the way I wonder where the 1e154 comes from, it seems impossible for a physical measurement). Fortunately, it's fairly easy to improve.
In the meantime, you can replace z1/z2 by z1*inv(z2) to avoid overflow.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: HP Prime complex division problem in CAS - parisse - 11-20-2020 04:55 PM



User(s) browsing this thread: 2 Guest(s)