Question for Parisse about CAS floating point

04072015, 02:44 AM
(This post was last modified: 04072015 03:26 AM by Joe Horn.)
Post: #6




RE: Question for Parisse about CAS floating point
(04062015 01:44 PM)compsystems Wrote: the nspire and ti68k calculators work with 12 digits, I think this should be the lower limit to improve accuracy, you say? That's merely what's shown in the display. The internal value in CAS is exactly: 15.343434343434267930206260643899440765380859375 Count the underlined digits. (04062015 01:44 PM)compsystems Wrote: nspire and ti68k calculators Notice that the Prime's value is identical to 12 decimal places, and in fact its result is closer to the actual value of 1519/99 than the competitions'. So, Prime wins that round. =) (04062015 01:44 PM)compsystems Wrote: //////////////// That's merely what's shown in the display. The internal value in CAS is exactly: 12.3456767676767498187473393045365810394287109375 Count the underlined digits. (04062015 01:44 PM)compsystems Wrote: nspire and ti68k calculators Notice that this time Prime's internal value is even more accurate than the competitions' results... 13 accurately rounded decimal places, not just 12. =) Random thought: Saying that Prime's accuracy in Home view is less than TI's, is like saying that a race car in low gear is slower than a motorcycle. It's true, but pointless. Yes, Home's results are limited to 12 BCD digits, but CAS results are slightly wider at 48 bits. If you want to compare Prime's accuracy with other machines, be fair and use Prime's CAS, rather than falsely implying that Prime is less accurate than other machines. Prime's internal values shown above were obtained by a version of my "hex" program, rewritten to output the exact decimal values. I'll post it in the Prime Software Gallery later this evening. Edit: The "dec" program is HERE. <0ΙΈ0> Joe 

« Next Oldest  Next Newest »

Messages In This Thread 
Question for Parisse about CAS floating point  jgoizueta  04052015, 06:01 PM
RE: Question for Parisse about CAS floating point  parisse  04062015, 06:43 AM
RE: Question for Parisse about CAS floating point  jgoizueta  04062015, 09:25 AM
RE: Question for Parisse about CAS floating point  compsystems  04062015, 01:44 PM
RE: Question for Parisse about CAS floating point  jgoizueta  04062015, 09:02 PM
RE: Question for Parisse about CAS floating point  Joe Horn  04072015 02:44 AM
RE: Question for Parisse about CAS floating point  jte  04102015, 07:58 PM
RE: Question for Parisse about CAS floating point  Joe Horn  04122015, 12:36 PM
RE: Question for Parisse about CAS floating point  jte  04122015, 08:11 PM
RE: Question for Parisse about CAS floating point  parisse  04122015, 05:36 PM
RE: Question for Parisse about CAS floating point  parisse  04132015, 06:40 AM

User(s) browsing this thread: 1 Guest(s)