[HP-12C] Angular coefficent from linear regression off by 1
05-01-2016, 11:37 PM
Post: #3
 Dieter Senior Member Posts: 2,397 Joined: Dec 2013
RE: [HP-12C] 9-digit angular coefficent from linear regression off by 1
(05-01-2016 07:12 PM)bshoring Wrote:  My HP-38C, predecessor to the HP-12C (12C is modeled after the 38C) also gives 11.09933165. However my iPhone emulator of the 38C, which carries 15 or 16 digit accuracy yields 11.09933164.

Hmm... in this case all variables of the equation for calculating the regression slope (i.e. the various sums accumulated by Σ+) have at most five significant digits. So the result can be calculated exactly even with merely 10 digits, while both the 38C and the 12C should use 13 digits internally.

Using the formulas in the 15C manual, the exact result for the slope of the given data is 48,16 : 4,339 which any HP should be able to calculate exactly. ;-) So something else must be going on here.

Dieter
 « Next Oldest | Next Newest »

 Messages In This Thread [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-01-2016, 11:23 AM RE: HP-15C and 12C give different results to the same data set - bshoring - 05-01-2016, 07:12 PM RE: [HP-12C] 9-digit angular coefficent from linear regression off by 1 - Dieter - 05-01-2016 11:37 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-02-2016, 11:16 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - HP67 - 05-03-2016, 12:14 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-03-2016, 12:37 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Werner - 05-02-2016, 11:48 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-02-2016, 12:09 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 05-02-2016, 12:30 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Werner - 05-02-2016, 02:50 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 05-03-2016, 11:56 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Csaba Tizedes - 05-05-2016, 07:07 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Csaba Tizedes - 05-06-2016, 07:50 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 05-06-2016, 01:11 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Csaba Tizedes - 05-12-2016, 10:20 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Csaba Tizedes - 08-03-2016, 07:38 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 08-03-2016, 10:10 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Albert Chan - 01-19-2019, 05:36 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 01-21-2019, 08:10 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - bshoring - 05-09-2016, 07:33 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 05-11-2016, 05:58 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - bshoring - 05-12-2016, 06:32 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Csaba Tizedes - 05-12-2016, 10:05 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Dieter - 05-13-2016, 06:24 AM RE: [HP-12C] Angular coefficent from linear regression off by 1 - HP67 - 05-03-2016, 01:01 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-03-2016, 01:20 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Thomas Radtke - 05-06-2016, 01:55 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - HP67 - 05-03-2016, 01:33 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - Marcio - 05-03-2016, 01:49 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - HP67 - 05-03-2016, 01:59 PM RE: [HP-12C] Angular coefficent from linear regression off by 1 - bshoring - 05-13-2016, 07:54 PM

User(s) browsing this thread: 1 Guest(s)