Post Reply 
HP Prime CAS & Large numbers
09-27-2023, 06:37 PM
Post: #12
RE: HP Prime CAS & Large numbers
There is indeed a max for integers, in global.cc
Code:

  double powlog2float=1e4;
  int MPZ_MAXLOG2=8600; // max 2^8600 about 1K
As far as I remember, the long integer library is not optimal for integer operations (it uses Karatsuba multiplication, not FFT), if you multiply/divide really large integers it will be slow. There is always a trade-off between speed and size limits, and I tend to be conservative. I don't remember when the limits were set, if it's an heritage of the hp39gii, then they should probably be raised, perhaps multiplied by 10.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
HP Prime CAS & Large numbers - Bipman - 08-10-2017, 08:27 AM
RE: HP Prime CAS & Large numbers - Arno K - 08-10-2017, 11:35 AM
RE: HP Prime CAS & Large numbers - Bipman - 08-10-2017, 11:39 AM
RE: HP Prime CAS & Large numbers - Bipman - 08-10-2017, 02:03 PM
RE: HP Prime CAS & Large numbers - Bipman - 08-13-2017, 09:11 AM
RE: HP Prime CAS & Large numbers - parisse - 09-27-2023 06:37 PM
RE: HP Prime CAS & Large numbers - parisse - 09-29-2023, 10:46 AM



User(s) browsing this thread: 2 Guest(s)