Ghannam86
☆    

Jordan,
2015-12-17 00:43
(3024 d 18:03 ago)

Posting: # 15739
Views: 7,852
 

 futility design [Two-Stage / GS Designs]

Dear all,
Can you please advise if futility design in bioequivalence is acceptable for the different regulatory agencies ???


Edit: Category changed from Regulatives / Guidelines. [Helmut]
ElMaestro
★★★

Denmark,
2015-12-17 00:49
(3024 d 17:56 ago)

@ Ghannam86
Posting: # 15740
Views: 6,808
 

 futility design

Dear Ghannem86,

❝ Can you please advise if futility design in bioequivalence is acceptable for the different regulatory agencies ???


What is a futility design?

Pass or fail!
ElMaestro
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2015-12-17 01:06
(3024 d 17:39 ago)

@ ElMaestro
Posting: # 15741
Views: 6,798
 

 OT

❝ What is a futility design?


[image]
[image] Resistance is futile.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Ghannam86
☆    

Jordan,
2015-12-17 01:10
(3024 d 17:35 ago)

@ ElMaestro
Posting: # 15742
Views: 6,842
 

 futility design

❝ What is a futility design?


Futility design is a type of two stage design studies. In this design you may dose a group of volunteers then based on the results of the first group you may complete the study by adding a second group of subjects. alpha value will be 0.05 % and will not be changed to 0.0294 %.
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2015-12-17 01:35
(3024 d 17:10 ago)

@ Ghannam86
Posting: # 15743
Views: 6,840
 

 α [0, 0.05]

Hi Ghannam,

Please!

❝ Futility design is a type of two stage design studies. In this design you may dose a group of volunteers then based on the results of the first group you may complete the study by adding a second group of subjects. alpha value will be 0.05 % and will not be changed to 0.0294 %.


Splendid. Do you have a reference?

The EMA’s GL states “[…] the choice of how much alpha to spend at the interim analysis is at the company’s discretion”. ‘Splitting’ α to 0, 0.05 is tough. Of course you need a futility criterion in the interim. Which one do you have in mind? The GMR, the CI, an upper total sample size? Even more moderate splits (Haybittle/Peto or O’Brien/Fleming) lead to an inflation of the type I error (see this post).

library(Power2Stage)
power.2stage.fC(alpha=c(0, 0.05), n1=12, CV=0.24, fCrit="PE",
                fClower=0.8, theta0=1.25, powerstep=FALSE)

TSD with 2x2 crossover
Method B: alpha (s1/s2) = 0 0.05
No interim power monitoring step used
Target power in sample size est. = 0.8
Power calculation via non-central t approx.
CV1 and GMR = 0.95 in sample size est. used
Futility criterion PE outside 0.8 ... 1.25
BE acceptance range = 0.8 ... 1.25

CV = 0.24; n(stage 1) = 12; GMR= 0.95

1e+06 sims at theta0 = 1.25 (p(BE)='alpha').
p(BE)    = 0.058721
p(BE) s1 = 0.010094
Studies in stage 2 = 46.59%

Distribution of n(total)
- mean (range) = 19.3 (12 ... 108)
- percentiles
 5% 50% 95%
 12  12  40


I changed the category of the thread. Before we can discuss regulatory acceptance, you should tell us the exact background of your statistical method.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
d_labes
★★★

Berlin, Germany,
2015-12-17 09:49
(3024 d 08:56 ago)

@ Ghannam86
Posting: # 15744
Views: 7,011
 

 futility design = SSR ?

Dear Ghannam86,

like Helmut I await more infos on the background of your "futility design". A term I never heard up to now.
Meanwhile for me this sounds like something that is called sample size re-estimation (SSR) design, blinded or not.1,2

Naively applied one would expect to be able to use alpha = 0.05 since no BE decision is taken in the "first" stage and therefore no alpha has to be spent. There is some rumor out there that some (leading?) regulatory authority has accepted such thinking.

But as Helmut has already shown above using a variant of Potvin Method B and alpha in stage 1 = 0:

library(Power2Stage)
power.2stage.ssr(alpha=0.05, n1=12, CV=0.25, blind=FALSE, theta0=1.25)


TSD with 2x2 crossover
 with sample size re-estimation (only)
Nominal alpha = 0.05
Sample size est. based on power calculated via non-central t approx.
with CV1, GMR = 0.95 and targetpower = 0.8
BE acceptance range = 0.8 ... 1.25

CV= 0.25; n(stage 1) = 12

1e+06 sims at theta0 = 1.25 (p(BE)='alpha').
p(BE)    = 0.059582
Studies in stage 2 = 94.82%

Distribution of n(total)
- mean (range) = 28.6 (12 ... 124)
- percentiles
 5% 50% 95%
 12  26  50


There is an alpha-inflation! Should (!) be not acceptable for regulators.
This was noticed by Golkowski1 for blinded SSR, and is well known, although in the context of superiority testing with parallel groups, back to 1990.3 Or even back to Stein's paper in 1945.4 See also.5

How "futility" comes into play I await your specification.


  1. Golkowski D, Friede T, Kieser M
    "Blinded sample size re-estimation in crossover bioequivalence trials"
    Pharm Stat. 2014 May-Jun;13(3):157-62. Epub 2014 Apr 9
  2. Jones B, Kenward MG
    "Design and Analysis of Cross-Over Trials"
    Third edition, Chapman and Hall/CRC, Boca Raton, Oct 2014
    Chapter 12
  3. Wittes J, Brittain E
    "The role of internal pilot studies in increasing the efficiency of clinical trials"
    Stat Med, Vol. 9, 65-72 (1990)
  4. Stein, C.
    "A two-sample test for a linear hypothesis whose power is independent of the variance"
    Annals of Mathematical Statistics 16, 243-258 (1945)
  5. Wittes et al.
    "Internal Pilot Studies I: Type I Error Rate of the NAIVE t-Test"
    Statist. Med. 18, 3481-3491 (1999)

Regards,

Detlew
nobody
nothing

2015-12-17 12:01
(3024 d 06:44 ago)

@ d_labes
Posting: # 15745
Views: 6,750
 

 futility design = SSR ?

...sometimes (quite freqently, recently, I must admit) I think, there is some kind of dark universe out there and there are things going on I don't even want to imagine... btw. Merry Christmas everbody!

Kindest regards, nobody
d_labes
★★★

Berlin, Germany,
2015-12-17 13:52
(3024 d 04:53 ago)

@ nobody
Posting: # 15746
Views: 6,738
 

 OT dark universe

...sometimes (quite freqently, recently, I must admit) I think, there is some kind of dark universe out there and there are things going on I don't even want to imagine... btw. Merry Christmas everbody!


Totally correct!
Merry Christmas and a Happy New Year to everbody & nobody!

Regards,

Detlew
UA Flag
Activity
 Admin contact
22,957 posts in 4,819 threads, 1,636 registered users;
67 visitors (0 registered, 67 guests [including 4 identified bots]).
Forum time: 18:46 CET (Europe/Vienna)

Nothing shows a lack of mathematical education more
than an overly precise calculation.    Carl Friedrich Gauß

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5