ElMaestro
★★★

Denmark,
2017-08-17 15:02
(2414 d 22:49 ago)

Posting: # 17706
Views: 6,769
 

 Potvin designs w. imbalance - what would you expect? [Two-Stage / GS Designs]

Hi all,

I decided to look into the effects of imbalance on Potvin designs.
This is plain hell, since the Potvin equations only work for balanced situations. So I either have to derive equations that work for imbalance or I have to do everything on basis of matrix algebra in which case I need to switch to R in stead of C.
I went for the latter and had to find ways to speed up the fits. Done now, took some hundred hours.

The practical (though possibly not ideal) way of looking into imbalance is to force imbalance into stage 2. I.e. we look at stage 1 as normal, then we calculate stage 2 normally and expect balance but we happen to loose e.g. 1 or 2 or whatever subjects from, say, sequence RT.
That is how I am implementing it now.

I am looking at my results now and trying to figure out if there is a story in this. So let me ask you experts: Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power and type I error (i.e. any difference from table I in Potvin's work), if 2 subjects go lost in sequence RT during stage 2?

Note: 2 RT subjects cannot go lost in stage two if there is only 1 per sequence at this stage, in which case I have programmed the loss as 1.

And yes, I know, the underlying imbalance model is not ideal - much better to assume random dropouts across sequences and stages, but that is speed-wise almost impossible to implement. It would simply take forever to compute it with my skills. Let me add, since stage 2's are often (not always, just often in practice) much larger than stage 1's (when N go small and CV go high) there is not much of a crime committed byu focusing on imbalance arising at the second stage.

Have a good day and thanks for any input.

Pass or fail!
ElMaestro
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2017-09-12 03:41
(2389 d 10:09 ago)

@ ElMaestro
Posting: # 17802
Views: 5,520
 

 Dropouts in stage 2

Hi ElMaestro,

❝ I am looking at my results now and trying to figure out if there is a story in this. So let me ask you experts: Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power and type I error (i.e. any difference from table I in Potvin's work), if 2 subjects go lost in sequence RT during stage 2?


Both the type I error and power will be lower than with a complete stage 2. Hence, if we use a framework which controls the TIE and estimate the sample size of stage 2 with an appropriate algo (1 df less than usual due to the stage term) we should not be worried about the TIE – a smaller sample size translates into a lower chance to show BE and hence, also a lower TIE. Like in fixed sample designs the impact of dropouts on power will be small.

On the other hand, in TSDs it is not a clever idea to include more than the estimated n2 subjects (greedy CROs selling “additional subjects in order to compensate for potential loss in power due to dropouts” to sponsors). That’s a no-go because it might inflate the TIE. The literature on GSDs and adaptive methods is full of tricks adjusting the final α if the planned sample size was overrun. You don’t want to go there.

Not for an old salt like you but novices: If you think about modifying one of the validated frameworks it is mandatory to assess the operational characteristics (TIE, power) in simulations. Pocock’s α 0.0294 is not a natural constant. General rules: Futility criteria lower the TIE, whereas a minimum stage 2 sample size might lead to an inflated TIE.
Example: Molins et al.* modified Potvin’s methods by introducing a futility Nmax 150 and a minimum n2 of 1.5×n1. Their adjusted α was 0.0301 for ‘modified B’ and 0.0280 for ‘modified C’.


  • Molins E, Cobo E, Ocaña J. Two‐stage designs versus European scaled average designs in bioequivalence studies for highly variable drugs: Which to choose? Stat Med. 2017;36(30):4777–88. doi:10.1002/sim.7452.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2017-09-19 19:17
(2381 d 18:33 ago)

@ ElMaestro
Posting: # 17819
Views: 5,124
 

 Dropouts continued

Hi ElMaestro,

had a closer look into the loss of power due to dropouts.

❝ Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power […], if 2 subjects go lost in sequence RT during stage 2?


❝ […] stage 2's are often (not always, just often in practice) much larger than stage 1's…


Larger is OK but too large isn’t. With the exception of Xu’s methods (my current favorite) you don’t reach the target power with small n1. ‘Potvin B’:

                   power
n1  N (median) stage 1 final
12      44      0.0671 0.784
14      44      0.104  0.799
16      44      0.155  0.810
24      36      0.413  0.830
30      30      0.566  0.834

In your example final power is 78.4%, 93.1% of studies proceed to the second stage, and the median total sample size is 44. Let’s add dropouts and see what happens to power.

 N  power
44  0.779
43  0.768
42  0.757
41  0.745
40  0.733

If n1 is small you are punished twice: You don’t reach the target power and the total sample sizes will be larger.
My current practice is to use n1 which is ~75–80% of the fixed sample design with a ‘best-guess’ CV. With n1 30 we exceed the target power with 83.4%, only 41.8% studies proceed to the second stage (i.e., you have a 56.6% chance to show BE already in the first), and the median total sample size is 30 (!). OK, the mean is 39… The distribution looks like that:

[image]


Even with a futility (Nmax 64) final power is with 77.6% close to the target but power in the first stage is still 56.6%. With a futility on the total sample size you can not only ease the sponsor but – hopefully – the BSWP. The Type I Error drops from 0.0440 to 0.0427.

I don’t like small first stages.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
UA Flag
Activity
 Admin contact
22,957 posts in 4,819 threads, 1,639 registered users;
80 visitors (0 registered, 80 guests [including 6 identified bots]).
Forum time: 12:51 CET (Europe/Vienna)

Nothing shows a lack of mathematical education more
than an overly precise calculation.    Carl Friedrich Gauß

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5