Maybe; but watch the TIE! [Two-Stage / GS Designs]
❝ There are some People who recommend to use a very small alpha in the first stage and a large alpha in the next.
❝
❝ Stage I: 0.001 leading to 99.8% CI
❝ Stage II: 0.049 leading to 90.2% CI
Your values are according to Haybittle/Peto. However, like Pocock’s “magic 0.0294” these numbers were derived for superiority testing in group sequential designs (normal distributed data, parallel groups). I know some companies routinely applying this “method” but obviously never ever assessed the type I error in the BE setting (equivalence, crossover). The GL is clear:
… appropriate steps must be taken to preserve the overall type I error of the experiment …
… the choice of how much alpha to spend at the interim analysis is at the company’s discretion.
library(Power2Stage)
power.2stage(method="B", alpha=c(0.001, 0.049), n1=12, GMR=0.95,
CV=0.22, targetpower=0.8, theta0=1.25, nsims=1e6)
# Method B: alpha (s1/s2) = 0.001 0.049
# Target power in power monitoring and sample size est. = 0.8
# BE margins = 0.8 ... 1.25
# CV = 0.22; n(stage 1)= 12; GMR = 0.95
# GMR = 0.95 and mse of stage 1 in sample size est. used
# Futility criterion Nmax = Inf
# 1e+06 sims at theta0 = 1.25 (p(BE)='alpha').
# p(BE) = 0.058031
library(Power2Stage)
power.2stage(method="B", alpha=c(0.001, 0.0413), n1=12, GMR=0.95,
CV=0.22, targetpower=0.8, theta0=1.25, nsims=1e6)
# Method B: alpha (s1/s2) = 0.001 0.0413
# Target power in power monitoring and sample size est. = 0.8
# BE margins = 0.8 ... 1.25
# CV = 0.22; n(stage 1)= 12; GMR = 0.95
# GMR = 0.95 and mse of stage 1 in sample size est. used
# Futility criterion Nmax = Inf
# 1e+06 sims at theta0 = 1.25 (p(BE)='alpha').
# p(BE) = 0.049939
library(Power2Stage)
power.2stage(method="B", alpha=c(0.01, 0.04), n1=12, GMR=0.95,
CV=0.24, targetpower=0.8, theta0=1.25, nsims=1e6)
Method B: alpha (s1/s2) = 0.01 0.04
Target power in power monitoring and sample size est. = 0.8
BE margins = 0.8 ... 1.25
CV = 0.24; n(stage 1)= 12; GMR = 0.95
GMR = 0.95 and mse of stage 1 in sample size est. used
Futility criterion Nmax = Inf
1e+06 sims at theta0 = 1.25 (p(BE)='alpha').
p(BE) = 0.048782
❝ Chance of approval in the first go is low, but you will have a comfortable CI in the second stage.
Correct. If one does not want to take the chance to show BE already in the first stage and has enough time to almost always proceed to the second stage, why not? The first stage serves only to get an estimate of the CV and can be seen as an “internal pilot study”. Compared to published methods with an equal split of alphas the sample size penalty is lower.
❝ However, as I learned from our famous captain, it is almost impossible to argue that it makes a practical difference.
Ahoy! Difference to what?
❝ What is your experience?
See above for the thoughtless application of 0.001/0.049 which leads to an inflated TIE. Sooner or later the BSWP (which has TSDs on their work-plan for 2015) will realize this problem. Consequences? Recalculate studies with a wider CI? What if a study fails with a 91.74% CI which passed with the reported 90.20% CI?
- Zheng C, Zhao L, Wang J. Modifications of sequential designs in bioequivalence trials. Pharm Stat. 2015;14(3):180–8. doi:10.1002/pst.1672.
Dif-tor heh smusma 🖖🏼 Довге життя Україна!
![[image]](https://static.bebac.at/pics/Blue_and_yellow_ribbon_UA.png)
Helmut Schütz
![[image]](https://static.bebac.at/img/CC by.png)
The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Complete thread:
- Does unequal alpha distribution make sense? Dr_Dan 2015-05-19 08:29 [Two-Stage / GS Designs]
- Maybe; but watch the TIE!Helmut 2015-05-28 15:04
- Advantages d_labes 2015-06-05 09:35
- Advantages ElMaestro 2015-06-05 10:07
- Advantages – performance measure d_labes 2015-06-05 11:21
- Advantages – performance measure Helmut 2015-06-05 13:29
- Advantages – performance measure d_labes 2015-06-05 21:27
- Advantages – performance measure Helmut 2015-06-05 23:29
- Histogram wonder d_labes 2015-06-06 12:58
- Histogram charlatanry Helmut 2015-06-09 13:43
- Histogram beauty d_labes 2015-06-09 14:55
- Histogram beast Helmut 2015-06-09 15:24
- Histogram beauty d_labes 2015-06-09 14:55
- Histogram charlatanry Helmut 2015-06-09 13:43
- Histogram wonder d_labes 2015-06-06 12:58
- Advantages – performance measure Helmut 2015-06-05 23:29
- Advantages – performance measure d_labes 2015-06-05 21:27
- Advantages – performance measure Helmut 2015-06-05 13:29
- Advantages – performance measure d_labes 2015-06-05 11:21
- Advantages ElMaestro 2015-06-05 10:07
- Advantages d_labes 2015-06-05 09:35
- Does unequal alpha distribution make sense? Dr_Dan 2015-05-29 08:33
- Does unequal alpha distribution make sense? ElMaestro 2015-05-29 09:31
- Does unequal alpha distribution make sense? nobody 2015-05-29 12:56
- Old beliefs die hard Helmut 2015-05-29 13:27
- Old beliefs die hard nobody 2015-05-29 13:41
- Old beliefs die hard Helmut 2015-05-29 18:08
- Old beliefs die hard ElMaestro 2015-05-29 18:57
- Old beliefs die hard nobody 2015-05-29 20:06
- ♩ ♪♫♬`·.¸¸.·´`·.¸¸. Helmut 2015-06-02 01:52
- TSD only an option in exceptional cases Dr_Dan 2015-06-02 08:00
- TSD only an option in exceptional cases nobody 2015-06-02 09:23
- TSD only an option in exceptional cases Dr_Dan 2015-06-02 08:00
- Old beliefs die hard ElMaestro 2015-05-29 18:57
- Old beliefs die hard Helmut 2015-05-29 18:08
- Old beliefs die hard nobody 2015-05-29 13:41
- Old beliefs die hard Helmut 2015-05-29 13:27
- Does unequal alpha distribution make sense? nobody 2015-05-29 12:56
- Does unequal alpha distribution make sense? ElMaestro 2015-05-29 09:31
- Banana splits Helmut 2015-06-02 00:48
- Maybe; but watch the TIE!Helmut 2015-05-28 15:04