github.com/open-simh.simtools
1
0
Fork 0
mirror of https://github.com/open-simh/simtools.git synced 2026-01-26 04:01:44 +00:00
Code Issues Projects Releases Wiki Activity

For now, solve the precision problem with brute force,

Browse Source 
by using long double where available.
Unfortunately, it won't be available everywhere, so a better solution
would still be nice.
Also, sometimes rounding of smaller sizes doesn't work right yet.
This commit is contained in:
Olaf Seibert
2021-01-18 23:11:00 +01:00
parent 37abe35427
commit 8aea1498c5
3 changed files with 91 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tests/test-float.mac
View File

@@ -26,3 +26,7 @@
.flt4 72057594037927936 ; 056200 000000 000000 000000
.flt4 72057594037927937 ; 056200 000000 000000 000001
.flt4 144115188075855873 ; 1 << 57 +1
; 056400 000000 000000 000000 (rounded!)