Post Reply 
Flawed prime factorization program and unexpected 15C simulator behaviour
11-18-2015, 05:53 PM
Post: #2
RE: Flawed prime factorization program and unexpected 15C simulator behaviour
(11-18-2015 02:54 PM)Harald Wrote:  Reason being that 9876543210 Enter 2 / FRAC returns 4294967296?!?
What is going on here? Am I making a mistake somewhere? Or is this a bug?
I added a division sign before FRAC. I assume you just forgot it.

Now back to your question. If it's a simulator it might just use binary arithmetic which can produce strange results.

Marcus von Cube
Wehrheim, Germany
http://www.mvcsys.de
http://wp34s.sf.net
http://mvcsys.de/doc/basic-compare.html
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Flawed prime factorization program and unexpected 15C simulator behaviour - Marcus von Cube - 11-18-2015 05:53 PM



User(s) browsing this thread: 1 Guest(s)