Post Reply 
Improve precision of float numbers
04-17-2019, 05:07 AM
Post: #12
RE: Improve precision of float numbers
@Claudio: Thanks for guiding me to the source of newRPL. Very impressive and for me a good reference for details - but I agree it doesn't fit in my small MCU.

@Jonathan: Thanks for this hint. Impressive, comprehensive and easy readable code. DEC64 is similar to what I intended. I expected to get rid of bit shifting and & operations by separating mantissa and exponent in different (struct) variables. And I agree with you - to implement entering and displaying of numbers is not easy. First shots cost me approx. 5k ... I worry if I find room for "real" calculator stuff.

Finally I'm close to give up and do it with the intrinsic double format - even if it's 7-decimal-precision only.

Find all posts by this user
Quote this message in a reply
Post Reply 

Messages In This Thread
RE: Improve precision of float numbers - deetee - 04-17-2019 05:07 AM

User(s) browsing this thread: 1 Guest(s)