Float is float [Software]

posted by PharmCat  – Russia, 2020-12-18 19:53 (77 d 08:59 ago) – Posting: # 22150
Views: 1,416

(edited by PharmCat on 2020-12-18 21:02)

Hi all,

This is very trivial story... let's take

a = 0.1

next float is:

julia> nextfloat(0.1)


julia> nextfloat(0.1) - 0.1

float numbers is discrete... you can't use 0.10000000000000001 ...

you can use rational numbers:

julia> 5//10 - 4//10 - 1//10 == -4//10 - 1//10 + 5//10

or some packages for working with big decimals

julia> using Decimals
julia> decimal(0.5)-decimal(0.4)-decimal(0.1) == decimal(-0.4)-decimal(0.1)+decimal(0.5)

I think in R it can be done... and never use Excel for cacl...

edit: or you can do float(big(1//10)) if you just need more precision...


» which is just “noise”

you should be very careful with eps() because this is not an indicator of accuracy

you can use something like:

a = 1e-70
b = 2e-70
b - a

end it will work fine, problems begans whe you do somesing like: 2.0 + 1e-70 , but you can still use 2.0 * 1e-70 without problems ...

make sure not to sum numbers with difference in eps() times ...

for comparation

all.equal(target, current, tolerance = sqrt(.Machine$double.eps))

can be used, but for small numbers you should adjust tolerance

Complete thread:

 Admin contact
21,370 posts in 4,463 threads, 1,495 registered users;
online 13 (0 registered, 13 guests [including 3 identified bots]).
Forum time: Saturday 04:52 UTC (Europe/Vienna)

If debugging is the process of removing bugs,
then programming must be the process of putting them in.    Edsger W. Dijkstra

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz