(12C) Avoid Overflow and Underflow calculations
04-09-2019, 06:06 AM (This post was last modified: 04-09-2019 06:07 AM by Gamo.)
Post: #1
 Gamo Senior Member Posts: 625 Joined: Dec 2016
(12C) Avoid Overflow and Underflow calculations
Sometimes problems to solve for is very large or very small integers when doing
arithmetic with very large and or very small integers it will give you the result of Error message.
This very handy steps can help avoid this problem that can be calculate manually or by programming.

----------------------------------------------------------

To Multiply Large Numbers: a x b : LN(a) + LN(b)

To Divide Large Numbers: a / b : LN(a) - LN(b)

-----------------------------------------------------------

Here is the example if you need to solve for ab / cd

Normal operation is (a x b) divided by (c x d)

-----------------------------------------------------------
Example: 987 E90 x 987654321 / 789 E90 x 123456789

987 [EEX] 90 [ENTER]
987654321 [ENTER]
789 [EEX] 90 [ENTER]
123456789 [R/S] display 10.0076 // Assuming result in FIX 4

-----------------------------------------------------------
Program: For Very Large or Very Small Integer of ab / cd
Code:
 LN STO 3 Rv LN STO 2 Rv LN STO 1 Rv LN RCL 1 + RCL 2  RCL 3 + - e^x

Gamo
 « Next Oldest | Next Newest »

User(s) browsing this thread: 1 Guest(s)