Casio rounding

11132018, 01:19 PM
(This post was last modified: 11132018 01:20 PM by Pekis.)
Post: #1




Casio rounding  
11132018, 04:24 PM
Post: #2




RE: Casio rounding
It is nice to see how well old manual does things.
Nowadays, this rounding stuff have to discover by yourself ... Casio FX115MS: 1E11 + 1  1E11 => 0, 1E11  1  1E11 => 0 Casio FX3650P : 1E11 + 1  1E11 => 0, 1E11  1  1E11 => 1 Both Casio had a display bug: e => 2.718281828 Ans÷10 => 0.271828182 Ans÷10 => 0.027182818 Ans÷10 => 2.718281828e03 

11142018, 01:59 PM
Post: #3




RE: Casio rounding
Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more.


11142018, 03:39 PM
Post: #4




RE: Casio rounding
(11142018 01:59 PM)Eddie W. Shore Wrote: Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more. For statistics, the rule is round to the nearest even digit: Round to one decimal place: 5.55 ==> 5.6 5.45 ==> 5.4 Tom L I don't care for whom you voted. If you put ice in your beer, you're crazy. 

11142018, 04:28 PM
Post: #5




RE: Casio rounding
(11142018 01:59 PM)Eddie W. Shore Wrote: Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more. I think it's just the usual trick that some calculators do to "correct" small roundoff errors instead of leaving them alone. However, these "corrections" can make the result worse. For example, 920/99 would produce an internal answer of 9.29292929292 or 9.29292929293 which the FX602P would round off internally to 9.29292929300 before any subsequent operations were performed on it. (I haven't tested this on an actual FX602P.) — Ian Abbott 

11192018, 01:46 PM
Post: #6




RE: Casio rounding
(11142018 03:39 PM)toml_12953 Wrote:(11142018 01:59 PM)Eddie W. Shore Wrote: Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more. I don't think I was familiar with this method (Banker's method if I recall correctly) until Richard Nelson's talk about rounding methods at HHC 2018. 

11192018, 03:05 PM
Post: #7




RE: Casio rounding
(11192018 01:46 PM)Eddie W. Shore Wrote:(11142018 03:39 PM)toml_12953 Wrote: For statistics, the rule is round to the nearest even digit: I think it's popular with statisticians since it tends to reduce rounding error when given a large sample population. Tom L I don't care for whom you voted. If you put ice in your beer, you're crazy. 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)