HP Forums / HP Calculators (and very old HP Computers) / HP Prime v / Unreliable complex calculation in CAS? Bug?

Post Reply 
Unreliable complex calculation in CAS? Bug?
04-07-2020, 11:53 PM (This post was last modified: 04-08-2020 12:33 AM by victorvbc.)
Post: #2
victorvbc Offline
Member
 		Posts: 71
Joined: Jun 2019
RE: Unreliable complex calculation in CAS? Bug?
It's a numerical precision thing. Both real and imaginary parts are in the order of 10^-14. Since you have to calculate the arc tangent of the ratio of these coordinates to get the angle, for such small values it depends on the numerical error.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Unreliable complex calculation in CAS? Bug? - victorvbc - 04-07-2020 11:53 PM



User(s) browsing this thread: 2 Guest(s)

Contact Us | The Museum of HP Calculators | Return to Top | Return to Content | Lite (Archive) Mode | RSS Syndication