Floating point arithmetic, again [Software]

posted by ElMaestro  – Denmark, 2020-12-10 22:05 (131 d 14:35 ago) – Posting: # 22132
Views: 2,345

Hi Ohlbe,

> 0==(0.8-0.4-0.2-2*0.1)
[1] TRUE
> 0==(.1+0.8-0.4-0.2-3*0.1)
[1] FALSE


We (as in us humans) should just switch to binary and we'd never have these discussions. We can still keep the metric system but to keep things easy we may wish to define a millimeter as 1/1024 of a meter, if we wish to impress someone by our ability to do division and multiplication in our heads :-D


In a nutshell, try:
a=.11111111111111111111111111111111111111111111111111111111
b=.111111111111111111111111111111111111111111111111111111111
(a-b)==0



Edit: two posts merged [Ohlbe]

Pass or fail!
ElMaestro

Complete thread:

Activity
 Admin contact
21,419 posts in 4,475 threads, 1,510 registered users;
online 18 (0 registered, 18 guests [including 5 identified bots]).
Forum time: Wednesday 13:40 CEST (Europe/Vienna)

In the Middles Ages the lingua franca of science was Latin.
Nowadays the language of science is bad English.    Anonymous

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5