Mahesh M
★    

India,
2014-06-17 13:12
(3958 d 12:39 ago)

Posting: # 13072
Views: 6,875
 

 Add-on and Two-Stage Designs [Two-Stage / GS Designs]

Dear All,

what are the difference between Add-on and Two-Stage Designs?

Regards


Edit: Category changed. [Helmut]
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2014-06-17 15:36
(3958 d 10:15 ago)

@ Mahesh M
Posting: # 13073
Views: 5,973
 

 Add-on designs obsolete!

Hi Mahesh,
  • in Add-on designs one performs the study as a conventional fixed sample design and – if BE could not be demonstrated – add a second group of subjects and perform a new BE assessment of pooled data. This method was mentioned in Health Canada’s guidances from the early 1990s. It was shown in nu­mer­ous publi­cations that the patient’s risk will be inflated (i.e., >5%) by this method. Therefore, HC/HPFB/TGD abandoned it in 2012. Background:
    • The entire α of 5% is already spent in the first analysis.
    • Nothing is “left” for the second analysis. Therefore, due to multiple testing the type I error will be >5%. This is not acceptable.
    The only regulation where Add-on designs are still acceptable is the Japanese. :not really:

  • In Two-Stage Sequential Designs you follow particular frameworks which will maintain the type I error at 5%. For details and references see my presentations, f.i. this one.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Mahesh M
★    

India,
2014-06-18 08:38
(3957 d 17:12 ago)

@ Helmut
Posting: # 13079
Views: 5,695
 

 Add-on designs obsolete!

Dear Helmut,

Thank you so much for your valuable response.

Regards
Mahesh
jag009
★★★

NJ,
2014-06-18 18:04
(3957 d 07:47 ago)

@ Helmut
Posting: # 13082
Views: 5,764
 

 Add-on designs obsolete!

Hi Helmut!

❝ It was shown in numerous publi­cations that the patient’s risk will be inflated (i.e., >5%) by this method. Therefore, HC/HPFB/TGD abandoned it in 2012.


Can you point me to some of those publications? I wasn't "born" yet back then :-) so I would gain some knowledge.

❝ The only regulation where Add-on designs are still acceptable is the Japanese. :not really:


This is surprising since the Japanese are so strict on quality. When I was visiting Japan, I noticed that their groceries (packaged items) have very short expiry dates (like 2 weeks)...

Thanks
John
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2014-06-18 21:41
(3957 d 04:10 ago)

@ jag009
Posting: # 13086
Views: 5,925
 

 Add-on designs obsolete!

Hi John!

❝ Can you point me to some of those publications?


One example is “Method A” of Potvin’s orginal paper. Although the algo contains an intermediate power calculation (which could lead to stopping in the first stage) α is not adjusted (i.e., kept at 0.05 in all steps). In other words, it is a – little bit more conservative – add-on design. However, they faced inflation. Quote:

The type I error for Method A is seen to be inflated in certain scenarios. For example, with a first stage of 12 subjects, the inflation in type I error rate is up to about 16% (to 0.058). […] Because Method A clearly did not satisfy our requirement for at most a neg­li­gible in­crease in type I error rate, we […] did not consider Method A further.

Hauck et al.1 reported a type I error of up to 0.0614 for medium variability (CV 24%). Cui et al.2 showed an example, where the actual type I error was 0.037 (at a nominal α of 0.025). That’s ~50% inflation. Coffey and Muller3 wrote about internal pilot studies:

Unfortunately, for some values […] the design may nearly double αt.

Note that Ref’s 2&3 dealt not with BE in a cross-over design but with superiority testing / parallel groups.
For the Japanese Add-On I would expect ~50% inflation since the second group is ½ of the first and no adjustment is done.

❝ ❝ The only regulation where Add-on designs are still acceptable is the Japanese.

❝ This is surprising since the Japanese are so strict on quality.


Two years ago at the BA/BE-conference in Kobe I tried to discuss this topic. By my standards I was very polite and started by praising their new guidelines. Next I talked about patient’s risk, which is compromised in their Add-On approach. I tried to explain it in simple words, like “The entire α is already ‘spent’ in the failed study. Nothing is ‘left’ for the add-on part. Any additional evaluation will inflate the patient’s risk.” The head of the Japanese authority replied: “Thank You!” I waited a good while for something more to come, but she gave me nothing else than a Siamese smile. :-D

❝ When I was visiting Japan, I noticed that their groceries (packaged items) have very short expiry dates (like 2 weeks)...


What about?
[image]


  1. Hauck WW, Preston PE, Bois FY. A group sequential approach to crossover trials for average bioequivalence. J Biopharm Stat. 1997;7(1):87–96. doi:10.1080/10543409708835171.
  2. Cui L, Hung HMJ, Wang S-J. Modification of Sample Size in Group Sequential Clinical Trials. Biometrics. 1999;55(3):853–7. doi:10.1111/j.0006-341X.1999.00853.x.
  3. Coffey CS, Muller KE. Controlling Test Size While Gaining the Benefits of an Internal Pilot Design. Biometrics. 2001;57(2):625–31. doi:10.1111/j.0006-341X.2001.00625.x.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
UA Flag
Activity
 Admin contact
23,424 posts in 4,927 threads, 1,709 registered users;
36 visitors (0 registered, 36 guests [including 10 identified bots]).
Forum time: 01:51 CEST (Europe/Vienna)

Do not worry about your difficulties in mathematics.
I can assure you mine are still greater.    Albert Einstein

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5