EMA: α-inflation – the sus­pi­cion begins to mount [RSABE / ABEL]

posted by Helmut Homepage – Vienna, Austria, 2014-07-21 04:04 (4361 d 05:49 ago) – Posting: # 13279
Views: 17,367

Dear all,

maybe some of you remember this interesting scary discovery of Detlew. This week a paper was pub­lished by a German group* confirming his findings. Appetizers:

Surprisingly, when ‘scaled’ bioequivalence limits were set as bioequivalence limits, the highest re­jec­tion rate observed was at the lowest variability investigated. With CVANOVA of 30%, it was 7.05%, and it was still 5.39% with a variability of 40%. Therefore, taking into account a simulation error of roughly 0.5%, and the fact that our simulations are based on uncorrelated data and do not consider interindividual variabilities, one may doubt that an α-error of 5% is controlled even with the pre-set ‘scaled’ limits, at least for variabilities close to the cut-off point of CVANOVA of 30%.

(* significantly >0.05; my addition)

Try this code:

library(PowerTOST)
CV  <- seq(30, 50, 5)
res <- data.frame(CV = CV, N = c(22, 25, 27, 27, 28),
                  GMR = scABEL(CV/100)[, "upper"], pBE = NA, sig = "",
                  stringsAsFactors = FALSE)
for (j in seq_along(CV)) {
  res$pBE[j] <- round(100*power.scABEL(CV = CV[j]/100, theta0 = res$GMR[j],
                                       n = res$N[j], design = "2x3x3",
                                       nsims = 1e6), 2)
}
sig <- binom.test(0.05*1e6, 1e6, alternative = "less")$conf.int[[2]]
res$sig[res$pBE/100 > sig] <- "*"
names(res)[5] <- ""
print(res, row.names = FALSE)


Do these results look familiar?

 CV  N      GMR  pBE 
 30 22 1.250000 6.88 *
 35 25 1.294796 5.42 *
 40 27 1.340165 5.04 *
 45 27 1.385915 4.34 
 50 28 1.431910 3.32


If you are planning a study for evaluation with EMA’s ABEL-method think about it.



Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Complete thread:

UA Flag
Activity
 Admin contact
23,655 posts in 4,993 threads, 1,570 registered users;
322 visitors (0 registered, 322 guests [including 14 identified bots]).
Forum time: 09:53 CEST (Europe/Vienna)

Most scientists today are devoid of ideas, full of fear, intent on
producing some paltry result so that they can add to the flood
of inane papers that now constitutes “scientific progress”
in many areas.    Paul Feyerabend

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5