Floating point arithmetic, again [Software]

posted by ElMaestro  – Denmark, 2020-12-10 22:05 (532 d 16:02 ago) – Posting: # 22132
Views: 5,848

Hi Ohlbe,

0==(0.8-0.4-0.2-2*0.1)
[1] TRUE
0==(.1+0.8-0.4-0.2-3*0.1)
[1] FALSE



We (as in us humans) should just switch to binary and we'd never have these discussions. We can still keep the metric system but to keep things easy we may wish to define a millimeter as 1/1024 of a meter, if we wish to impress someone by our ability to do division and multiplication in our heads :-D


In a nutshell, try:
a=.11111111111111111111111111111111111111111111111111111111
b=.111111111111111111111111111111111111111111111111111111111
(a-b)==0



Edit: two posts merged. [Ohlbe]

Pass or fail!
ElMaestro

Complete thread:

UA Flag
Activity
 Admin contact
22,108 posts in 4,630 threads, 1,567 registered users;
online 9 (0 registered, 9 guests [including 4 identified bots]).
Forum time: Friday 15:08 CEST (Europe/Vienna)

We absolutely must leave room for doubt
or there is no progress and no learning.
There is no learning without having to pose a question.
And a question requires doubt.
People search for certainty.
But there is no certainty.    Richard Feynman

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5