Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 22:46 (2014 d 19:25 ago) – Posting: # 22131
Views: 27,782

Hi ElMaestro,

❝ Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.


Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

UA Flag
Activity
 Admin contact
23,654 posts in 4,992 threads, 1,571 registered users;
139 visitors (0 registered, 139 guests [including 14 identified bots]).
Forum time: 19:11 CEST (Europe/Vienna)

Scientists often have a naïve faith that
if only they could discover enough facts about a problem,
these facts would somehow arrange themselves
in a compelling and true solution.    Theodosius Dobzhansky

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5