Bioequivalence and Bioavailability Forum • floating-point math is always more complex than you think it is

floating-point math is always more complex than you think it is [Software]

posted by mittyri – Russia, 2019-07-20 22:43 (427 d 20:25 ago) – Posting: # 20416
Views: 4,501

Hi ElMaestro,

» Match(6, 6.001, 0.01)
»
» Ugly as hell :vomit:

, and will not work well if you get into extreme binary representations.

take a look at
if (Abs(x - y) <= absTol * Max(1.0f, Abs(x), Abs(y)))
the description is here

One may consider ULP, pros and cons described here

—
Kind regards,
Mittyri

Complete thread:

Spreadsheet failures, any recent examples? ElMaestro 2019-07-18 13:43 [Software]
- Spreadsheet failures, any recent examples? Ohlbe 2019-07-18 14:32
  - Spreadsheet addiction Helmut 2019-07-18 16:12
    - Nasty beast Ohlbe 2019-07-18 17:30
      - Nasty beast Helmut 2019-07-18 20:26
        
        Nasty beast Ohlbe 2019-07-19 11:32
        
        Nasty beast ElMaestro 2019-07-19 12:32
        
        Decidedly off topic Ohlbe 2019-07-19 13:38
        
        OT: R limbo 101 Helmut 2019-07-19 13:00
    - Spreadsheet addiction Shuanghe 2019-07-18 18:59
      - Spreadsheet addiction Helmut 2019-07-18 20:04
        
        OT: Spreadsheet addiction Shuanghe 2019-07-19 12:41
        
        OT: Spreadsheet addiction Helmut 2019-07-19 14:29
        
        OT: Spreadsheet addiction nobody 2019-07-19 15:53
        
        OT: Spreadsheet addiction Helmut 2019-07-19 19:32
  - Spreadsheet etc. failures zizou 2019-07-20 00:18
    - As designed ☺ Helmut 2019-07-20 02:12
      - As designed ☺ ElMaestro 2019-07-20 09:08
        
        To round or not to round… Helmut 2019-07-20 12:53
        
        To round or not to round… ElMaestro 2019-07-20 19:59
        
        floating-point math is always more complex than you think it ismittyri 2019-07-20 22:43