Flawed prime factorization program and unexpected 15C simulator behaviour
|
11-18-2015, 05:53 PM
Post: #2
|
|||
|
|||
RE: Flawed prime factorization program and unexpected 15C simulator behaviour
(11-18-2015 02:54 PM)Harald Wrote: Reason being that 9876543210 Enter 2 / FRAC returns 4294967296?!?I added a division sign before FRAC. I assume you just forgot it. Now back to your question. If it's a simulator it might just use binary arithmetic which can produce strange results. Marcus von Cube Wehrheim, Germany http://www.mvcsys.de http://wp34s.sf.net http://mvcsys.de/doc/basic-compare.html |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)