chrisk ☆ 2022-08-09 20:55 (853 d 23:38 ago) Posting: # 23209 Views: 7,221 |
|
Dear all, Thank you for those who created the wonderful PowerTOST package and who are sharing their knowledge in this forum. My question relates to the sample size calculation for 3-way crossover (e.g. 3x6x3). I want to demonstrate that both test drugs T1 and T2 are BE to the reference R. The althernative hypothesis is: T1 = R and T2 = R. When performing the sample size calculation using PowerTOST for 3-way crossover, which alternative is considered? Since there are several ways to formulate the alternatives, I wasn't sure whether the current settings of PowerTOST correspond to the one that is of my interest. If it doesn't, what is your recommendation to deal with my scenario of interest? Any reference will also be very much appreciated. Another question is related to the number of PK parameters included. Does the sample size calculation consider the number of PK parameters for the BE? Thank you for your help on this. Edit: Category changed; see also this post #1. [Helmut] |
Helmut ★★★ Vienna, Austria, 2022-08-10 13:30 (853 d 07:03 ago) @ chrisk Posting: # 23210 Views: 6,702 |
|
Hi Chris, ❝ Thank you for those who created the wonderful PowerTOST package and who are sharing their knowledge in this forum. Welcome. ❝ […] 3-way crossover (e.g. 3x6x3). I want to demonstrate that both test drugs T1 and T2 are BE to the reference R. The althernative hypothesis is: T1 = R and T2 = R. ❝ ❝ When performing the sample size calculation using PowerTOST for 3-way crossover, which alternative is considered? Since there are several ways to formulate the alternatives, I wasn't sure whether the current settings of PowerTOST correspond to the one that is of my interest. If it doesn't, what is your recommendation to deal with my scenario of interest? Use the script mentioned in the previous post. ❝ Another question is related to the number of PK parameters included. Does the sample size calculation consider the number of PK parameters for the BE? You have to demonstrate BE for all PK metrics. Therefore, it is a little bit more difficult to show BE for the FDA and China’s CDE (Cmax, AUC0–t, AUC0–∞) than in other jurisdictions, where AUC0–∞ is not required. Since the CV of Cmax is generally larger than the one of AUC, no problem. If you pass BE of Cmax, likely you will pass AUC as well. You don’t have be worried about multiplicity issues because the Type I Error is controlled by the Intersection-Union Tests (IUT).* Therefore, you don’t need to adjust the α-level of the tests, i.e., the common 90% CI is just fine. Since you want to demonstrate equivalence of both test treatments to the reference, the same logic applies here. Hence, base the sample size estimation on the worst case, i.e., the PK metric of T1 or T2 where you expect the largest deviation from R and/or which shows the largest CV. For the ‘Two at Time’ approach use the argument bal = TRUE :
A , B , and C for your T1 , T2 , and R . Maybe I will modify the script later. No promises. An ugly quick-shot at the end. For period-balance of the IBDs we have to round 32 up to to next multiple of 6. Hence, we gain power for the worst case metric. Of course, power for the other metrics is pretty high. At least for those you have some room to navigate and are protected against surprises.Only if you would have an OR-conjunction (you are happy that either of the tests passes), you would have to use alpha <- 0.025 and assess the study with 95% CIs because you get two chances (see there). In the example you would need 42 subjects.
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
chrisk ☆ 2022-08-10 17:24 (853 d 03:09 ago) @ Helmut Posting: # 23211 Views: 6,378 |
|
Thanks again, Helmut, for sharing your wisdom so quickly and in details. Since the alternative is based on T1 = R OR T2 = R, I am attempted to think that a larger sample size is required for the alternative T1 = R AND T2 = R. Is that indeed the case? If so, would you have any recommendation on how to approach the sample size estimation? Thanks again, I very much appreciate your help! |
Helmut ★★★ Vienna, Austria, 2022-08-10 17:58 (853 d 02:35 ago) @ chrisk Posting: # 23212 Views: 6,409 |
|
Hi Chris, ❝ Thanks again, Helmut, for sharing your wisdom so quickly and in details. When you know something, say what you know. When you don’t know something, say that you don’t know. That is knowledge. Confucius I know much less about anything than I know about something. Wisdom is not my thing. ❝ Since the alternative is based on T1 = R OR T2 = R, … Are you trying to confuse me? In your OP you stated: ❝ ❝ ❝ I want to demonstrate that both test drugs T1 and T2 are BE to the reference R. That’s an AND-conjunction, right? ❝ … I am attempted to think that a larger sample size is required for the alternative T1 = R AND T2 = R. Is that indeed the case? Correct! In an OR-conjunction in your case you get at least two chances (either T1 or T2 passes or both). In the most simple case* you have to use Bonferroni’s adjustment $$\alpha_\text{adj}=\alpha/k\small{,}\tag{1}$$ where \(\alpha\) is the nominal level of the test and \(\small{k}\) the number of tests. Then the family-wise error rate is controlled with $$FWER=1-\left(1-\alpha_\text{adj}\right)^k\tag{2}$$ You have to adjust only for T1 | T2 = R (two tests). ❝ If so, would you have any recommendation on how to approach the sample size estimation? See the last paragraph of my previous post. Call the script with alpha = 0.025 .
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
chrisk ☆ 2022-08-10 19:46 (853 d 00:48 ago) @ Helmut Posting: # 23213 Views: 6,362 |
|
Thank you Helmut. My latest question was due to my imprudence. My alternative of interst is the one with "AND", indeed. But this exercise was still helpful since I naively expected the "OR" alternative to result in a smaller sample size compared with the "AND" alternative. I failed to realise that a type I error comes into play for the "OR" alternative, which explains a larger sample size (n=42 vs n=36). Thank you also for modifying the R program. I sincerely appreciate your time and efforts. And lastly, thank you for correcting me on the difference between wisdom and knowledge Thank you for sharing your knowledge! Have a wonderful day! |
Helmut ★★★ Vienna, Austria, 2022-08-10 22:59 (852 d 21:34 ago) @ chrisk Posting: # 23214 Views: 6,372 |
|
Hi Chris, ❝ But this exercise was still helpful since I naively expected the "OR" alternative to result in a smaller sample size compared with the "AND" alternative. I failed to realise that a type I error comes into play for the "OR" alternative, which explains a larger sample size (n=42 vs n=36). In my workshops I use to give this example:
❝ Thank you also for modifying the R program. I sincerely appreciate your time and efforts. Welcome. I would suggest to use the original one because it is more flexible and shows the seed for reproducibility / documentation. Answers based on the cumulative probability of the binomial distribution (hint: Bernoulli process). In :
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
chrisk ☆ 2022-08-11 00:00 (852 d 20:33 ago) @ Helmut Posting: # 23215 Views: 6,289 |
|
Hi Helmut, Thanks again for this explanation. After some thoughts, I am wondering if the sample size estimation only considers one comparison. I found an old following post regarding this topic. If we are considering both T1=R and T2=R, perhaps, we need to look at the bivariate distribution of the two test statistics when looking at the power. And these should be correlated as well, which makes things complicated. I am maybe missing something and was wondering if you could enlighten me on this subject. Thank you sincerely! |
Helmut ★★★ Vienna, Austria, 2022-08-11 17:25 (852 d 03:09 ago) @ chrisk Posting: # 23216 Views: 6,283 |
|
Hi Chris, ❝ After some thoughts, I am wondering if the sample size estimation only considers one comparison. I found an old following post regarding this topic. Oh dear, that one! Opening Pandora’s box. However, only relevant if one would assess the study with the ‘All at Once’ approach (i.e., an ANOVA of pooled data). The jury left the courtroom 2½ years ago and hasn’t returned ever since… ❝ If we are considering both T1=R and T2=R, perhaps, we need to look at the bivariate distribution of the two test statistics when looking at the power. And these should be correlated as well, which makes things complicated. I am maybe missing something and was wondering if you could enlighten me on this subject. In the ‘Two at a Time’ approach T1 and T2 are treated independently. Hence, you have two separate distributions. You see that also in the evaluation, where you obtain two residual variance estimates. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
chrisk ☆ 2022-08-12 18:02 (851 d 02:31 ago) @ Helmut Posting: # 23221 Views: 6,267 |
|
Thanks again for your help on this, Helmut. ❝ Oh dear, that one! Opening Pandora’s box. However, only relevant if one would assess the study with the ‘All at Once’ approach (i.e., an ANOVA of pooled data). The jury left the courtroom 2½ years ago and hasn’t returned ever since… And my apologies for opening the Pandora's box! I will pretend that I never wrote this ❝ In the ‘Two at a Time’ approach T1 and T2 are treated independently. Hence, you have two separate distributions. You see that also in the evaluation, where you obtain two residual variance estimates. Here, I still am a bit confused. Since my alternative is T1=R AND T2=R, I need to carry out 2 tests. Both have to be rejected at a given significance (without adjustment, say 0.05) and jointly, these 2 tests have to achieve a given power (say 0.8). Here is where I am confused: 1) The 2 tests must jointly have a power > 0.8. For illustration, if we assume independence of these 2 tests (which is clearly not the case but for the sake of illustration), we want to achieve the following: power(test1, test2) = power(test1) x power(test2) = 0.8 If we further assume equal power for test 1 and test 2, then we need sqrt(0.8) = 0.9 for each test. When computing the sample size in PowerTOST, I am wondering whether the power argument is for the joint tests, or for individual test. If it's specified at an individual level, the joint power is 0.8 x 0.8 = 0.64. 2) I understand that T1 and T2 are treated independently. But are they assumed to be independent from R, as well? Even if T1, T2 and R are pairwise independent, R appears in both test statistics so the two tests will show correlation. Does this correlation taken into account when computing the sample size? In my naive opinion, I feel that, under the alternative which stipulates BE, the PK parameters should be correlated between treatments and this correlation should be taken into account. Thanks again for your guidance! |
Helmut ★★★ Vienna, Austria, 2022-08-17 17:04 (846 d 03:30 ago) @ chrisk Posting: # 23224 Views: 6,058 |
|
Hi Chris, sorry for the late reply; busy with answering stupid deficiency letters… ❝ ❝ Oh dear, that one! Opening Pandora’s box. ❝ And my apologies for opening the Pandora's box! I will pretend that I never wrote this ❝ Here, I still am a bit confused. Since my alternative is T1=R AND T2=R, I need to carry out 2 tests. Both have to be rejected at a given significance (without adjustment, say 0.05) and jointly, these 2 tests have to achieve a given power (say 0.8). Here is where I am confused: ❝ ❝ 1) The 2 tests must jointly have a power > 0.8. For illustration, if we assume independence of these 2 tests (which is clearly not the case but for the sake of illustration), we want to achieve the following: ❝ power(test1, test2) = power(test1) x power(test2) = 0.8 ❝ ❝ If we further assume equal power for test 1 and test 2, then we need sqrt(0.8) = 0.9 for each test. When computing the sample size in PowerTOST, I am wondering whether the power argument is for the joint tests, or for individual test. If it's specified at an individual level, the joint power is 0.8 x 0.8 = 0.64. That’s a fallacy. I fell into this trap myself. See post dealing with overall power of multiple studies. ❝ 2) I understand that T1 and T2 are treated independently. But are they assumed to be independent from R, as well? ❝ Even if T1, T2 and R are pairwise independent, R appears in both test statistics so the two tests will show correlation. Some, yes. To which degree is unknown. Consider this: AUC is the PK metric of extent of absorption and Cmax the one of rate of absorption. Where the former in comparative BA depends only on the fractions absorbed ƒ (we assume that the doses are identical and clearances are constant), the latter is a composite metric, i.e., depends on ƒ, ka, and ke. Hence, it is clear that they are correlated, but how much? (Almost) everything is possible in PowerTOST .
❝ Does this correlation taken into account when computing the sample size? ❝ ❝ In my naive opinion, I feel that, under the alternative which stipulates BE, the PK parameters should be correlated between treatments and this correlation should be taken into account. As you rightly wrote, since R occurs in both tests, likely there is some correlation indeed. But (but!) from where and how will you get it? In the exercise of two metrics we failed to establish a consistent value (see this lenghty thread for our desperate attempts)… With T1=R AND T2=R we are fishing in the dark. You would have to perform a couple of studies (at least three) to come up with an estimate of \(\rho\) which you could use in the sample size estimation of the fourth. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |