Bioequivalence and Bioavailability Forum • Potvin designs w. imbalance

ElMaestro
★★★

Denmark,
2017-08-17 15:02
(2793 d 02:36 ago)

Posting: # 17706
Views: 8,320

Potvin designs w. imbalance - what would you expect? [Two-Stage / GS Designs]

Hi all,

I decided to look into the effects of imbalance on Potvin designs.
This is plain hell, since the Potvin equations only work for balanced situations. So I either have to derive equations that work for imbalance or I have to do everything on basis of matrix algebra in which case I need to switch to R in stead of C.
I went for the latter and had to find ways to speed up the fits. Done now, took some hundred hours.

The practical (though possibly not ideal) way of looking into imbalance is to force imbalance into stage 2. I.e. we look at stage 1 as normal, then we calculate stage 2 normally and expect balance but we happen to loose e.g. 1 or 2 or whatever subjects from, say, sequence RT.
That is how I am implementing it now.

I am looking at my results now and trying to figure out if there is a story in this. So let me ask you experts: Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power and type I error (i.e. any difference from table I in Potvin's work), if 2 subjects go lost in sequence RT during stage 2?

Note: 2 RT subjects cannot go lost in stage two if there is only 1 per sequence at this stage, in which case I have programmed the loss as 1.

And yes, I know, the underlying imbalance model is not ideal - much better to assume random dropouts across sequences and stages, but that is speed-wise almost impossible to implement. It would simply take forever to compute it with my skills. Let me add, since stage 2's are often (not always, just often in practice) much larger than stage 1's (when N go small and CV go high) there is not much of a crime committed byu focusing on imbalance arising at the second stage.

Have a good day and thanks for any input.

—
Pass or fail!
ElMaestro

Helmut
★★★

Vienna, Austria,
2017-09-12 03:41
(2767 d 13:56 ago)

@ ElMaestro
Posting: # 17802
Views: 6,733

Dropouts in stage 2

Post reply

Hi ElMaestro,

❝ I am looking at my results now and trying to figure out if there is a story in this. So let me ask you experts: Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power and type I error (i.e. any difference from table I in Potvin's work), if 2 subjects go lost in sequence RT during stage 2?

Both the type I error and power will be lower than with a complete stage 2. Hence, if we use a framework which controls the TIE and estimate the sample size of stage 2 with an appropriate algo (1 df less than usual due to the stage term) we should not be worried about the TIE – a smaller sample size translates into a lower chance to show BE and hence, also a lower TIE. Like in fixed sample designs the impact of dropouts on power will be small.

On the other hand, in TSDs it is not a clever idea to include more than the estimated n₂ subjects (greedy CROs selling “additional subjects in order to compensate for potential loss in power due to dropouts” to sponsors). That’s a no-go because it might inflate the TIE. The literature on GSDs and adaptive methods is full of tricks adjusting the final α if the planned sample size was overrun. You don’t want to go there.

Not for an old salt like you but novices: If you think about modifying one of the validated frameworks it is mandatory to assess the operational characteristics (TIE, power) in simulations. Pocock’s α 0.0294 is not a natural constant. General rules: Futility criteria lower the TIE, whereas a minimum stage 2 sample size might lead to an inflated TIE.
Example: Molins et al.* modified Potvin’s methods by introducing a futility N_max 150 and a minimum n₂ of 1.5×n₁. Their adjusted α was 0.0301 for ‘modified B’ and 0.0280 for ‘modified C’.

Molins E, Cobo E, Ocaña J. Two‐stage designs versus European scaled average designs in bioequivalence studies for highly variable drugs: Which to choose? Stat Med. 2017;36(30):4777–88. doi:10.1002/sim.7452.

—
Dif-tor heh smusma 🖖🏼 Довге життя Україна!
Helmut Schütz

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Helmut
★★★

Vienna, Austria,
2017-09-19 19:17
(2759 d 22:20 ago)

@ ElMaestro
Posting: # 17819
Views: 6,342

Dropouts continued

Post reply

Hi ElMaestro,

had a closer look into the loss of power due to dropouts.

❝ Let us say we look at e.g. CV=.3 and N1=12 (6 per sequence at stage 1). What would you expect in terms of power […], if 2 subjects go lost in sequence RT during stage 2?

❝

❝ […] stage 2's are often (not always, just often in practice) much larger than stage 1's…

Larger is OK but too large isn’t. With the exception of Xu’s methods (my current favorite) you don’t reach the target power with small n₁. ‘Potvin B’:

power n1 N (median) stage 1 final 12 44 0.0671 0.784 14 44 0.104 0.799 16 44 0.155 0.810 24 36 0.413 0.830 30 30 0.566 0.834

In your example final power is 78.4%, 93.1% of studies proceed to the second stage, and the median total sample size is 44. Let’s add dropouts and see what happens to power.

N power 44 0.779 43 0.768 42 0.757 41 0.745 40 0.733

If n₁ is small you are punished twice: You don’t reach the target power and the total sample sizes will be larger.
My current practice is to use n₁ which is ~75–80% of the fixed sample design with a ‘best-guess’ CV. With n₁ 30 we exceed the target power with 83.4%, only 41.8% studies proceed to the second stage (i.e., you have a 56.6% chance to show BE already in the first), and the median total sample size is 30 (!). OK, the mean is 39… The distribution looks like that:

[image]

Even with a futility (N_max 64) final power is with 77.6% close to the target but power in the first stage is still 56.6%. With a futility on the total sample size you can not only ease the sponsor but – hopefully – the BSWP. The Type I Error drops from 0.0440 to 0.0427.

I don’t like small first stages.

—
Dif-tor heh smusma 🖖🏼 Довге життя Україна!
Helmut Schütz

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes