EMA: α-inflation – the sus­pi­cion begins to mount [RSABE / ABEL]

posted by Helmut Homepage – Vienna, Austria, 2014-07-21 04:04 (3538 d 08:29 ago) – Posting: # 13279
Views: 12,878

Dear all,

maybe some of you remember this interesting scary discovery of Detlew. This week a paper was pub­lished by a German group* confirming his findings. Appetizers:

Surprisingly, when ‘scaled’ bioequivalence limits were set as bioequivalence limits, the highest re­jec­tion rate observed was at the lowest variability investigated. With CVANOVA of 30%, it was 7.05%, and it was still 5.39% with a variability of 40%. Therefore, taking into account a simulation error of roughly 0.5%, and the fact that our simulations are based on uncorrelated data and do not consider interindividual variabilities, one may doubt that an α-error of 5% is controlled even with the pre-set ‘scaled’ limits, at least for variabilities close to the cut-off point of CVANOVA of 30%.

(* significantly >0.05; my addition)

Try this code:

library(PowerTOST)
CV  <- seq(30, 50, 5)
res <- data.frame(CV = CV, N = c(22, 25, 27, 27, 28),
                  GMR = scABEL(CV/100)[, "upper"], pBE = NA, sig = "",
                  stringsAsFactors = FALSE)
for (j in seq_along(CV)) {
  res$pBE[j] <- round(100*power.scABEL(CV = CV[j]/100, theta0 = res$GMR[j],
                                       n = res$N[j], design = "2x3x3",
                                       nsims = 1e6), 2)
}
sig <- binom.test(0.05*1e6, 1e6, alternative = "less")$conf.int[[2]]
res$sig[res$pBE/100 > sig] <- "*"
names(res)[5] <- ""
print(res, row.names = FALSE)


Do these results look familiar?

 CV  N      GMR  pBE 
 30 22 1.250000 6.88 *
 35 25 1.294796 5.42 *
 40 27 1.340165 5.04 *
 45 27 1.385915 4.34 
 50 28 1.431910 3.32


If you are planning a study for evaluation with EMA’s ABEL-method think about it.



Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Complete thread:

UA Flag
Activity
 Admin contact
22,957 posts in 4,819 threads, 1,639 registered users;
104 visitors (0 registered, 104 guests [including 6 identified bots]).
Forum time: 11:33 CET (Europe/Vienna)

Nothing shows a lack of mathematical education more
than an overly precise calculation.    Carl Friedrich Gauß

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5