Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 21:46 (36 d 08:31 ago) – Posting: # 22131
Views: 1,031

Hi ElMaestro,

» Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.

Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

Activity
 Admin contact
21,303 posts in 4,441 threads, 1,488 registered users;
online 7 (0 registered, 7 guests [including 5 identified bots]).
Forum time: Saturday 06:17 CET (Europe/Vienna)

If you can’t solve a problem, then there is an easier problem
you can solve: find it.    George Pólya

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5