Floating point arithmetic, again [Software]

posted by Ohlbe – France, 2020-12-10 21:46 (532 d 15:17 ago) – Posting: # 22131
Views: 5,870

Hi ElMaestro,

» Impossible to tell if this is an effect from Excel or from some degree of streamlining within the CPU.

Same behaviour in [image]:

0==(0.8-0.4-0.2-0.1-0.1)
[1] TRUE


Regards
Ohlbe

Complete thread:

UA Flag
Activity
 Admin contact
22,108 posts in 4,630 threads, 1,567 registered users;
online 6 (0 registered, 6 guests [including 3 identified bots]).
Forum time: Friday 14:03 CEST (Europe/Vienna)

We absolutely must leave room for doubt
or there is no progress and no learning.
There is no learning without having to pose a question.
And a question requires doubt.
People search for certainty.
But there is no certainty.    Richard Feynman

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5