Post Reply 
42s Code Editor - floats issue
05-02-2015, 07:37 PM (This post was last modified: 05-02-2015 07:42 PM by pito.)
Post: #3
RE: 42s Code Editor - floats issue
(05-02-2015 07:06 PM)Mark Hardman Wrote:  The 42s only has 11 digits of precision. Try rounding to 11 places.
Tried this on a real 42s and on Free42. Neither allowed more than 11 digits after the decimal in PGM mode.
Thanks!
I see the first two numbers now, the third is zero (see below attached).

The new issue I see is I cannot use E-2 notation, editor shoots an error, grrh.
Code:
0.02715245941 ok
0.027152459412 does not fit, shows zero in free42
2.7152459412E-2 (or shorter) shoots an error in editor (err opcode)
271524594118E-13 (or shorter) shoots an error in editor (err opcode)

I wonder why free42 cannot accept up to 25 digits numbers..


Attached File(s) Thumbnail(s)
   
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
42s Code Editor - floats issue - pito - 05-02-2015, 06:56 PM
RE: 42s Code Editor - floats issue - pito - 05-02-2015 07:37 PM
RE: 42s Code Editor - floats issue - pito - 05-02-2015, 08:00 PM
RE: 42s Code Editor - floats issue - Graan - 05-03-2015, 01:36 PM
RE: 42s Code Editor - floats issue - pito - 05-03-2015, 03:52 PM
RE: 42s Code Editor - floats issue - Graan - 05-04-2015, 05:27 AM
RE: 42s Code Editor - floats issue - pito - 05-05-2015, 04:09 PM
RE: 42s Code Editor - floats issue - Graan - 05-07-2015, 09:30 AM
RE: 42s Code Editor - floats issue - Graan - 05-07-2015, 02:54 PM
RE: 42s Code Editor - floats issue - pito - 05-07-2015, 07:26 PM
RE: 42s Code Editor - floats issue - Graan - 05-08-2015, 04:41 AM
RE: 42s Code Editor - floats issue - pito - 05-08-2015, 07:46 AM
RE: 42s Code Editor - floats issue - Graan - 05-08-2015, 11:12 AM
RE: 42s Code Editor - floats issue - pito - 05-08-2015, 05:34 PM



User(s) browsing this thread: 1 Guest(s)