Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 22:46 (1372 d 07:17 ago) – Posting: # 22131
Views: 10,744

Hi ElMaestro,

❝ Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.


Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

UA Flag
Activity
 Admin contact
23,223 posts in 4,877 threads, 1,655 registered users;
37 visitors (1 registered, 36 guests [including 8 identified bots]).
Forum time: 07:03 CEST (Europe/Vienna)

One of the symptoms of an approaching nervous breakdown
is the belief that one’s work is terribly important.    Bertrand Russell

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5