Post Reply 
Question for Parisse about CAS floating point
04-06-2015, 01:44 PM (This post was last modified: 04-06-2015 01:51 PM by compsystems.)
Post: #4
RE: Question for Parisse about CAS floating point
the nspire and ti68k calculators work with 12 digits, I think this should be the lower limit to improve accuracy, you say?

hp-prime calculator

approx(1519/99) => 15.3434343434 10 digits =(

nspire and ti68k calculators

approx(1519/99) => 15.343434343434 12 digits =)

////////////////

hp-prime calculator

approx(1222222/99000) => 12.3456767677 10 digits =(

nspire and ti68k calculators

approx(1222222/99000) => 12.345676767677 12 digits =)
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Question for Parisse about CAS floating point - compsystems - 04-06-2015 01:44 PM



User(s) browsing this thread: 1 Guest(s)