Post Reply 
New guy and programming problem
08-29-2017, 04:22 AM
Post: #26
RE: New guy and programming problem
(08-28-2017 06:13 PM)Dieter Wrote:  Well, for 90±5E–7° even on the 34s sin(x) rounds to 1 (in SP mode).
On a 10-digit machine this already happens for 89,9995°...90,0005°.
Even for 89°...91° three significant digits of 1 – sin(x) are lost.

Good point, I was wrong. For some reason I thought the flattest gradient was 1 not 0.


Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: New guy and programming problem - Paul Dale - 08-29-2017 04:22 AM
RE: New guy and programming problem - sasa - 09-01-2018, 03:18 PM
RE: New guy and programming problem - sasa - 09-01-2018, 05:33 PM



User(s) browsing this thread: