Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 21:46 (85 d 08:07 ago) – Posting: # 22131
Views: 1,787

Hi ElMaestro,

» Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.

Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

Activity
 Admin contact
21,370 posts in 4,463 threads, 1,495 registered users;
online 13 (0 registered, 13 guests [including 3 identified bots]).
Forum time: Saturday 05:53 CET (Europe/Vienna)

If debugging is the process of removing bugs,
then programming must be the process of putting them in.    Edsger W. Dijkstra

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5