Binary representation [Software]

posted by ElMaestro  – Denmark, 2018-03-16 13:13 (1317 d 15:05 ago) – Posting: # 18561
Views: 5,450

Hi Mittyri,

» x=0.250000
» as it should be
» :confused:

How nice, then it is also compiler-dependent...
The issue is that 0.05 cannot be represented accurately in a binary brain.
So, the compiler will need to deal with such a fraction and either round it up or round it down. Whatever it does, it can have downstream implications. In my case it implied that my simple naïve decimal logic (0.25 <=0.25) never evaluated to TRUE because it was not tested as such.
The solution could be to add e.g. 1e-8 to the righthand side. Dumb, but that's logic.
Computers suck.
:-D:-D:-D

Pass or fail!
ElMaestro

Complete thread:

Activity
 Admin contact
21,753 posts in 4,548 threads, 1,544 registered users;
online 6 (0 registered, 6 guests [including 5 identified bots]).
Forum time: Sunday 05:18 CEST (Europe/Vienna)

They were “so intent of making everything numerical”
that they frequently missed seeing
what was there to be seen.    Barbara McClintock

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5