BEQool ★ 2024-01-29 12:53 (355 d 09:28 ago) Posting: # 23845 Views: 4,168 |
|
Hello! I have searched the forum but couldn't find the answer to the following question: why does the sample size estimation with R with package PowerTOST differ between sampleN.TOST and sampleN.scABEL when CV=30%?Lets take a look at the following example: a) Sample size estimation with sampleN.TOST sampleN.TOST(CV=0.3, theta0=0.95, design="2x3x3") b) Sample size estimation with sampleN.scABEL sampleN.scABEL(CV=0.3, theta0=0.95, design="2x3x3") So why do the sample size estimations differ? They have the same arguments (design="2x3x3", theta0=0.95 ...). CV is 30% so there should be no scaling (conventional BE limits, i.e., 80.00-125.00). Does it have to do anything with simulations? But even when I increase number of simulations, the differences aren't that big. Or if I reformulate the question, why dont the following powers match: a) power.TOST(CV=0.3, theta0=0.95,design="2x3x3", n=30) b) power.scABEL(CV=0.3, theta0=0.95, design="2x3x3", n=30) Regards BEQool Edit: Category changed. [Helmut] |
Helmut ★★★ Vienna, Austria, 2024-01-29 14:52 (355 d 07:29 ago) @ BEQool Posting: # 23846 Views: 3,444 |
|
Hi BEQool, ❝ […]: why does the sample size estimation with R with package PowerTOST differ between Therefore, simulations are needed. At a true CVwR = 30% we have – roughly* – a 50% chance that in the actual study CVwR > 30%. Then we could expand the limits, gain power for a given sample size, or need less subjects for a certain power than we would need in ABE. ❝ So why do the sample size estimations differ? They have the same arguments (design="2x3x3", theta0=0.95 ...). CV is 30% so there should be no scaling (conventional BE limits, i.e., 80.00-125.00). You could also remove all scaling conditions. Then you get the same sample size than with sampleN.TOST() :reg <- reg_const(regulator = "USER", r_const = 1, CVswitch = Inf, CVcap = Inf, pe_constr = FALSE) ❝ Does it have to do anything with simulations? But even when I increase number of simulations, the differences aren't that big. ❝ Or if I reformulate the question, why dont the following powers match: ❝ a) ❝ [1] 0.8204004 ❝ b) ❝ [1] 0.85977 You asked the wrong question in b) because power.scABEL(CV=0.3, theta0=0.95, design="2x3x3", n=27) Let’s consider an example where expanding the limits is less likely.
BTW, I would never ever assume theta = 0.95 for a HVD(P). That’s why in the reference-scaling functions of PowerTOST theta = 0.90 is the default.
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
BEQool ★ 2024-01-30 11:52 (354 d 10:29 ago) @ Helmut Posting: # 23851 Views: 3,391 |
|
Thank you for the explanation, it seems I havent taken the distribution of CV into account (jumping over and below the limit CV=30%). ❝ Therefore, simulations are needed. At a true CVwR = 30% we have – roughly* – a 50% chance that in the actual study CVwR > 30%. Then we could expand the limits, gain power for a given sample size, or need less subjects for a certain power than we would need in ABE. ❝ […] Now the sample sizes are identical. Power for ABEL is slightly larger than for ABE because there is a certain – while small – chance to expand the limits. So the sample size with ABEL is always smaller or equal to ABE right (with the same arguments)? Similarly, power for the same number of subjects is always higher (or equal) with ABEL than with ABE (as shown in my reformulated question at the end of the first post or in your example with n=21 for ABE vs. ABEL)? Additional 2 questions popped into my head while thinking about this:
BEQool |
Helmut ★★★ Vienna, Austria, 2024-01-30 14:08 (354 d 08:13 ago) @ BEQool Posting: # 23852 Views: 3,323 |
|
Hi BEQool, ❝ So the sample size with ABEL is always smaller or equal to ABE right (with the same arguments)? Similarly, power for the same number of subjects is always higher (or equal) with ABEL than with ABE (as shown in my reformulated question at the end of the first post or in your example with n=21 for ABE vs. ABEL)? ❝ 1. So in case regulators (EMA region) ask us to calculate post hoc power (regardless of how irrelevant it is) … ❝ … of a study with 2x3x3 design with CVwr=25%, we should calculate it with ❝ And on the other hand, for Cmax we should calculate it with ❝ 2. Another hypothetical scenario: If we get information from the literature about a drug's CVw (Cmax) of around 30% (lets say a range of 25-35%) and if we get a drug's CVw of 22% from our pilot study, can we then do a regular study with design 2x3x3 (in case we get CVw for Cmax 35% so then we could widen the limits and use ABEL)? BTW, why do you want to use a partial replicate design and not one of the 2-sequence 3-period full replicate designs (TRT|RTR or TRR|RTT)? Acceptable for the EMA (see the Q&A document and this post for examples). Same degrees of freedom and similar sample sizes. More informative because you can also estimate CVwT, which is useful in designing other studies (quite often CVwT < CVwR and you need a smaller sample size). In the partial replicate you have to assume CVwT = CVwR, which is often wrong. ❝ And if then our drug's CVw from this regular study is lets say 21%, can agencies ask us to justify replicate 2x3x3 design as if why didnt we use conventional 2x2x2 design if we got CVw=22% in our pilot study? There is nothing to justify. Any study in a replicate design can also be assessed for ABE. My – former – best enemy once said »From a purely statistical perspective, all studies should be performed in a replicate design.« One of the rare occasions I agree with him. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
BEQool ★ 2024-02-04 20:24 (349 d 01:57 ago) @ Helmut Posting: # 23853 Views: 3,251 |
|
Sorry for my late response. ❝ Oh dear! EMA region, really‽ Outright bizarre. ❝ BTW, why do you want to use a partial replicate design and not one of the 2-sequence 3-period full replicate designs (TRT|RTR or TRR|RTT)? Acceptable for the EMA (see the Q&A document and this post for examples). Same degrees of freedom and similar sample sizes. More informative because you can also estimate CVwT, which is useful in designing other studies (quite often CVwT < CVwR and you need a smaller sample size). In the partial replicate you have to assume CVwT = CVwR, which is often wrong. Nevertheless, a deficiency letter regarding 2-sequence 3-period full replicate design from an European agency was already received (it was answered successfully) so 3-sequence 3-period partial replicate design is now used sometimes instead. ❝ By ‘regular study’ are you meaning a simple crossover? Even if you observed CVw ≥30% I would be cautious. That’s only a hint of a highly variable reference. See this article for details. ❝ There is nothing to justify. Any study in a replicate design can also be assessed for ABE. My – former – best enemy once said »From a purely statistical perspective, all studies should be performed in a replicate design.« One of the rare occasions I agree with him. BEQool |
Helmut ★★★ Vienna, Austria, 2024-02-04 22:12 (349 d 00:09 ago) @ BEQool Posting: # 23854 Views: 3,241 |
|
HI BEQool, ❝ Sorry for my late response. ❝ […] a deficiency letter regarding 2-sequence 3-period full replicate design from an European agency was already received (it was answered successfully) so 3-sequence 3-period partial replicate design is now used sometimes instead. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
BEQool ★ 2024-02-05 14:20 (348 d 08:01 ago) @ Helmut Posting: # 23855 Views: 3,175 |
|
❝ Fantastic! The European agency (which one?) should read – and accept – what is stated in the EMA’s Q&A-document. France and Ireland - however, it was for veterinary product |
Helmut ★★★ Vienna, Austria, 2024-02-05 17:01 (348 d 05:20 ago) @ BEQool Posting: # 23856 Views: 3,174 |
|
Hi BEQool, ❝ France and Ireland - however, it was for veterinary product — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
mittyri ★★ Russia, 2024-02-05 17:49 (348 d 04:32 ago) @ Helmut Posting: # 23857 Views: 3,240 |
|
Hi Helmut and BEQool! ❝ ❝ France and Ireland - however, it was for veterinary product ❝ This might explain it. The last time I read the vet-GL it was crap (politely speaking). That's interesting how CHMP EMA Guidelines invade CVMP Guidelines. I am trying to catch the logic: For substances with highly variable disposition where it is difficult to show bioequivalence due to high intra-individual variability, different alternative designs have been suggested in the literature (e.g. replicate study design). A replicate cross-over study design using 3 periods (partial replication where only the reference product is replicated in all animals) or 4 periods (full replication, where each subject receives the test and reference products twice) can be carried out. So CVMP people have some concerns about other designs we don't know yet. — Kind regards, Mittyri |