The Museum of HP Calculators

HP Forum Archive 19

[ Return to Index | Top of Index ]

HP 35s. FIX affects precision
Message #1 Posted by Pablo P (Spain) on 22 Oct 2010, 4:03 p.m.

Hi all, by accident I have found that FIX mode affects the precision in some calculations.

FIX mode is used to control the number of decimal digits used in the display of numbers. Only to display them. But consider the next:

Insert this function in the equation list: EXP(-SQ(U)/2)/SQRT(2*pi)

Set FIX to 3 and integrate the function between -5 and 2.88 You will get 0.997993696055

Set FIX to 5 and integrate the function between -5 and 2.88. You will get 0.99801133646

Similar results, but not identical. Should this be added to the infamous bug list? I don`t know if I am missing something...

Edited: 22 Oct 2010, 4:36 p.m.

      
Re: HP 35s. FIX affects precision
Message #2 Posted by Bart (UK) on 22 Oct 2010, 4:42 p.m.,
in response to message #1 by Pablo P (Spain)

Hi Pablo,

This is not actually a bug, but a feature. For more difficult or long integrations, you can specify a lower number of significant digits which will increase the speed of the integration at the cost of accuracy. See page 8-6 of the manual for more information.

Cheers,
Bart

            
Re: HP 35s. FIX affects precision
Message #3 Posted by Pablo P (Spain) on 22 Oct 2010, 5:04 p.m.,
in response to message #2 by Bart (UK)

Thanks Bart, I missed this feature. The manual explains it perfectly.

      
Re: HP 35s. FIX affects precision
Message #4 Posted by Dieter on 22 Oct 2010, 5:11 p.m.,
in response to message #1 by Pablo P (Spain)

No, this is not a bug but a (quite useful) feature of the HP35s an other calculators with the HP Integrate. It was already implemented in the good old 34C, the first model with this function.

The idea behind this: you set the desired accuracy (by setting the display format) and the calculator provides a result based on that setting. This way you can choose between better precision and faster execution. In Fix 3 the 35s assumes the function it's integrating is given with three valid decimals. In Sci 5 it assumes six significant digits. So, settings like "Fix 9" or even "ALL" will provide a very accurate result, but the 35s may be busy for a few minutes, while Fix 4 returns a result with adequate accuracy within reasonable time.

Of course, all this is documented in the handbook (page 8-2). You will also find a (quite conservative) estimate for the uncertainty of the result in the Y-register.

Dieter

            
Re: HP 35s. FIX affects precision
Message #5 Posted by Karl Schneider on 22 Oct 2010, 11:48 p.m.,
in response to message #4 by Dieter

Dieter --

Very good explanation. I'd add that FIX/SCI/ENG as integration-accuracy settings on the HP-35s, HP-33s, and HP-48/49/50 series don't have the same meaning as those on the HP-34C through the HP-32SII. An archived thread:

HP-33S estimated error of integration

A thorough explanation:

HP SOLVE/INTEG on all RPN-based models

-- KS

Edited: 22 Oct 2010, 11:49 p.m.


[ Return to Index | Top of Index ]

Go back to the main exhibit hall