floating-point math is always more complex than you think it is [Software]

posted by mittyri – Russia, 2019-07-20 22:43  – Posting: # 20416
Views: 2,192

Hi ElMaestro,

» Match(6, 6.001, 0.01)
»
» Ugly as hell :vomit:, and will not work well if you get into extreme binary representations.

take a look at
if (Abs(x - y) <= absTol * Max(1.0f, Abs(x), Abs(y)))
the description is here

One may consider ULP, pros and cons described here

Kind regards,
Mittyri

Complete thread:

Activity
 Admin contact
20,249 posts in 4,261 threads, 1,397 registered users;
online 17 (2 registered, 15 guests [including 7 identified bots]).
Forum time (Europe/Vienna): 15:51 CET

To call the statistician after the experiment is done
may be no more than asking him to perform a postmortem examination:
he may be able to say what the experiment died of.    R.A. Fisher

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5