Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 22:46 (837 d 17:04 ago) – Posting: # 22131
Views: 7,007

Hi ElMaestro,

❝ Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.


Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

UA Flag
Activity
 Admin contact
22,557 posts in 4,724 threads, 1,607 registered users;
23 visitors (0 registered, 23 guests [including 12 identified bots]).
Forum time: 16:50 CEST (Europe/Vienna)

Science is wonderfully equipped to answer the question “How?”
but it gets terribly confused when you ask the question “Why?”    Erwin Chargaff

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5