Post Reply 
Casio rounding
11-13-2018, 01:19 PM (This post was last modified: 11-13-2018 01:20 PM by Pekis.)
Post: #1
Casio rounding
Hello,

I found this in the Casio FX-602P manual:
What do you think of it ? I Wonder if it's specific to that model ...

[Image: casio-fx-602p-rounding.jpg]
Find all posts by this user
Quote this message in a reply
11-13-2018, 04:24 PM
Post: #2
RE: Casio rounding
It is nice to see how well old manual does things.
Nowadays, this rounding stuff have to discover by yourself ...

Casio FX-115MS: 1E11 + 1 - 1E11 => 0, 1E11 - 1 - 1E11 => 0
Casio FX-3650P : 1E11 + 1 - 1E11 => 0, 1E11 - 1 - 1E11 => -1

Both Casio had a display bug:

e => 2.718281828
Ans÷10 => 0.271828182
Ans÷10 => 0.027182818
Ans÷10 => 2.718281828e-03
Find all posts by this user
Quote this message in a reply
11-14-2018, 01:59 PM
Post: #3
RE: Casio rounding
Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more.
Visit this user's website Find all posts by this user
Quote this message in a reply
11-14-2018, 03:39 PM
Post: #4
RE: Casio rounding
(11-14-2018 01:59 PM)Eddie W. Shore Wrote:  Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more.

For statistics, the rule is round to the nearest even digit:

Round to one decimal place:
5.55 ==> 5.6
5.45 ==> 5.4

Tom L
Cui bono?
Find all posts by this user
Quote this message in a reply
11-14-2018, 04:28 PM
Post: #5
RE: Casio rounding
(11-14-2018 01:59 PM)Eddie W. Shore Wrote:  Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more.

I think it's just the usual trick that some calculators do to "correct" small round-off errors instead of leaving them alone. However, these "corrections" can make the result worse. For example, 920/99 would produce an internal answer of 9.29292929292 or 9.29292929293 which the FX-602P would round off internally to 9.29292929300 before any subsequent operations were performed on it. (I haven't tested this on an actual FX-602P.)

— Ian Abbott
Find all posts by this user
Quote this message in a reply
11-19-2018, 01:46 PM
Post: #6
RE: Casio rounding
(11-14-2018 03:39 PM)toml_12953 Wrote:  
(11-14-2018 01:59 PM)Eddie W. Shore Wrote:  Interesting. The rounding scheme seems to be has been arbitrarily chosen instead of going with the traditional rule of looking at the last digit and rounding up when it is 5 or more.

For statistics, the rule is round to the nearest even digit:

Round to one decimal place:
5.55 ==> 5.6
5.45 ==> 5.4

I don't think I was familiar with this method (Banker's method if I recall correctly) until Richard Nelson's talk about rounding methods at HHC 2018.
Visit this user's website Find all posts by this user
Quote this message in a reply
11-19-2018, 03:05 PM
Post: #7
RE: Casio rounding
(11-19-2018 01:46 PM)Eddie W. Shore Wrote:  
(11-14-2018 03:39 PM)toml_12953 Wrote:  For statistics, the rule is round to the nearest even digit:

Round to one decimal place:
5.55 ==> 5.6
5.45 ==> 5.4

I don't think I was familiar with this method (Banker's method if I recall correctly) until Richard Nelson's talk about rounding methods at HHC 2018.

I think it's popular with statisticians since it tends to reduce rounding error when given a large sample population.

Tom L
Cui bono?
Find all posts by this user
Quote this message in a reply
Post Reply 




User(s) browsing this thread: 1 Guest(s)