Search
Member List
Calendar
Help
HP Forums
/
HP Software Libraries
/
General Software Library 
/
(12C) Modulo (the remainder after division )
/
(12C) Modulo (the remainder after division )
|
(12C) Modulo (the remainder after division )
|
|
12-05-2019, 12:36 PM
Post: #6
|
|||
|
|||
|
RE: (12C) Modulo (the remainder after division )
Although that routine is very short, it suffers from roundoff error. It even gets the answer wrong for your example (as can be seen if you set FIX 9, as Dieter pointed out previously in this thread). The 10-step routine you posted previously gets the correct answer.
<0|ΙΈ|0> -Joe- |
|||
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
(12C) Modulo (the remainder after division ) - Gamo - 01-09-2018, 06:03 AM
RE: (12C) Modulo (the remainder after division ) - Dieter - 01-09-2018, 09:32 AM
RE: (12C) Modulo (the remainder after division ) - Gamo - 01-10-2018, 06:44 AM
RE: (12C) Modulo (the remainder after division ) - Gamo - 02-15-2018, 05:15 AM
RE: (12C) Modulo (the remainder after division ) - Gamo - 12-05-2019, 12:03 PM
RE: (12C) Modulo (the remainder after division ) - Joe Horn - 12-05-2019 12:36 PM
|
User(s) browsing this thread: 1 Guest(s)