cakhatri ★ India, 2017-11-30 10:44 (2623 d 21:16 ago) Posting: # 18024 Views: 16,883 |
|
Dear All, I would like to know 1.What BE limits should be taken into consideration while estimating sample size for replicate design studies for USFDA & EMA. Should it be 80-125% ? We normally use FARTSSIE Why the Question 1. For a product with 51% ISCV (from a completed partial replicate study UKMHRA) by using FARTSSIE we arrived at different sample size for EMA - Sample size estimated = 27 (80% Power, 95-105% T/R, Method C1, BE Limits 69.84 to 143.19%) - Sample size estimated = 76 (80% Power, 95-105% T/R, No reference Scaled BE Limits-80-125%) Which sample size should we consider for pivotal study Regards Chirag |
Helmut ★★★ Vienna, Austria, 2017-11-30 11:58 (2623 d 20:01 ago) @ cakhatri Posting: # 18025 Views: 15,865 |
|
Hi Chirag, ❝ What BE limits should be taken into consideration while estimating sample size for replicate design studies for USFDA & EMA. If you want to go with reference-scaling, none! The limits depend on the CVwR and are estimated in the actual study. Hence, you need simulations, where your assumed CVwR is the average. Either use the tables provided by the two Lászlós* or package PowerTOST for R. The software is open source and comes free of costs. ❝ Should it be 80-125% ? No (see above). Only if you don’t want reference-scaling (i.e., conventional ABE). Actually reference-scaling was introduced to avoid the extreme sample sizes required for ABE. ❝ We normally use FARTSSIE FARTSSIE cannot perform the necessary simulations and therefore, is not suitable for any of the reference-scaling methods. ❝ For a product with 51% ISCV (from a completed partial replicate study UKMHRA) by using FARTSSIE we arrived at different sample size for EMA ❝ ❝ - Sample size estimated = 27 (80% Power, 95-105% T/R, Method C1, BE Limits 69.84 to 143.19%) ❝ - Sample size estimated = 76 (80% Power, 95-105% T/R, No reference Scaled BE Limits-80-125%)
PowerTOST , start the R-console, and type library(PowerTOST) . If you want to make yourself familiar with PowerTOST , type help(package=PowerTOST) .Try these examples, where "2x2x4" denotes the 4-perod full replicate, "2x2x3" the 3-period full replicate, and "2x3x3" the 3-sequence 3-period (partial) replicate.
theta0=0.95 to the function calls but don’t blame me if the study fails. If you want 90% power instead of the default 80%, add the argument targetpower=0.90 .I suggest to perform a power analysis (recommended by ICH E9) assessing the influence of deviations from assumptions (lower/higher CVwR, T/R deviating more than expected from 100%, less eligible subjects due to dropouts). Try (with the default partial replicate):
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
Astea ★★ Russia, 2017-11-30 23:50 (2623 d 08:09 ago) (edited on 2017-12-01 14:18) @ Helmut Posting: # 18028 Views: 15,421 |
|
❝ FARTSSIE cannot perform the necessary simulations and therefore, is not suitable for any of the reference-scaling methods. Just few words in defence of FARTSSIE. May be the approximations are rude, far from exact PowerTOST (see #), but the results overally seems to be correlated for CV>30%:
design 2x2x4 2x2x3 (2x3x3 from Table) here F - FARTSSIE22 (note: sample size should be additionally rounded) R - PowerTOST v.1.4.6, sampleN.scABEL T- Table from Endrényi L, Tóthfalusi L. Sample Sizes for Designing Bioequivalence Studies for Highly Variable Drugs. J Pharm Pharmaceut Sci. 2011;15(1):73–84. (*edit: the last columns refers to 2x3x3 design) — "Being in minority, even a minority of one, did not make you mad" |
Helmut ★★★ Vienna, Austria, 2017-12-01 12:42 (2622 d 19:18 ago) @ Astea Posting: # 18029 Views: 15,563 |
|
Hi Astea, ❝ Just few words in defence of FARTSSIE. May be the approximations are rude, far from exact PowerTOST (see #), but the results overally seems to be correlated for CV>30%: Nope. The EMA’s ABEL not only means extending the limits (based on the observed – not the assumed CVwR) but also assessing the GMR-restriction. It’s a complex framework and therefore, no simple formula exists to calculate power. Try this one:
For all CVs FARTSSIE’s sample sizes will give the desired power for ABE (column pwr.ABE ) but not for ABEL (column pwr.FARTSSIE ). For CV 30% it will be too high (since only 34 subjects are required) but for CV >30% too low (more subjects are required). Only sampleN.scABEL() will give sample sizes (n.ABEL ) with at least the desired power (pwr.ABEL ).As expected, FARTSSIE screws completely up if one wants to assess the Type I Error. Set “Method C1” and the 4-period replicate. Try with CV 30%, T/R 125%, sample size 34. I got
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
Astea ★★ Russia, 2017-12-01 15:16 (2622 d 16:43 ago) @ Helmut Posting: # 18031 Views: 15,495 |
|
Dear Helmut! Thank you for enlightening this question! The advantage of R is doubtless. I just wanted to show FARTSSIE not worser than other rude methods of sample size estimation (remember nomogram and so on). (Sorry, I've made a mistake in the previous post, the data from the paper refers to partial replicate design 2x3x3.) By the way, for extreme numbers from the paper by Endrényi L, Tóthfalusi L. we also get slightly underpowered study: power.scABEL(CV=0.8,n=54,theta0=0.95,design="2x3x3") — "Being in minority, even a minority of one, did not make you mad" |
cakhatri ★ India, 2017-12-04 07:00 (2620 d 01:00 ago) @ Astea Posting: # 18032 Views: 15,191 |
|
Dear Helmut & Astea, Thankyou for the response. Honestly this is too much of statistics for me to understand. We are discussing with our statisticians & medical writing team to fully understand the response and implement accordingly. I shall revert in case of any queries Thankyou once again Regards Chirag |
Helmut ★★★ Vienna, Austria, 2017-12-04 16:07 (2619 d 15:53 ago) @ cakhatri Posting: # 18034 Views: 15,218 |
|
Hi Chirag, your statisticians should read the relevant papers and register here / ask questions directly. Better than playing Chinese whispers. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
cakhatri ★ India, 2017-12-05 06:33 (2619 d 01:27 ago) @ Helmut Posting: # 18035 Views: 15,086 |
|
Dear Helmut, Very True. The statistician was advised to do so and has already created a login yesterday or day before. Regards Chirag |
d_labes ★★★ Berlin, Germany, 2017-12-06 10:52 (2617 d 21:08 ago) @ Astea Posting: # 18037 Views: 14,993 |
|
Dear Astea! ❝ ... ❝ By the way, for extreme numbers from the paper by Endrényi L, Tóthfalusi L. we also get slightly underpowered study: ❝ ❝ [1] 0.79917 ❝ ❝ [1] 0.79782 ❝ ... The sample sizes in the paper of the two Laszlos are based on 10 000 simulations (only). Additionally the seed of the pseudo-random number generator for the sims was presumably different. Try this: power.scABEL(CV=0.8, n=54, theta0=0.95, design="2x3x3", nsims=10000) With nsims=1E6 and setseed=F on the other hand I don't succeed to obtain power>0.8 (20 tries).One more reason to use PowerTOST's power.scABEL() / sampleN.scABEL() functions . Also w.r.t the tables in the paper of the two Laszlos.— Regards, Detlew |
mittyri ★★ Russia, 2017-12-07 17:03 (2616 d 14:57 ago) @ d_labes Posting: # 18043 Views: 15,256 |
|
Dear Detlew, here comes a magik (citing the paper): The precision of the estimation was evaluated by running the simulations twenty times at twenty-two different conditions (different CV’s, different GMR’s and different designs). Seed was sampled 'unfortunately' about 20 times? — Kind regards, Mittyri |
d_labes ★★★ Berlin, Germany, 2017-12-07 19:21 (2616 d 12:39 ago) (edited on 2017-12-08 14:38) @ mittyri Posting: # 18044 Views: 14,891 |
|
Dear mittyri, ❝ here comes a magik (citing the paper): ❝ The precision of the estimation was evaluated by running the simulations twenty times at twenty-two different conditions (different CV’s, different GMR’s and different designs). ❝ ❝ ❝ Seed was sampled 'unfortunately' about 20 times? What do you mean by 'unfortunately'? This sentence describes an investigation of how precise the simulated power values are. Read the paragraph forward: "The standard deviation of the simulated powers (20 values under each combination of CV, GMR and design, each with 10 000 sims; my insertion) was calculated under each condition; the mean of these standard deviations was 0.460. Thus, the precision of the power estimation is about ±0.5%." They must have of course always choosen a different seed for the 20 repetitions under each combination of CV, GMR and design. Else you would get always the same result under each combination. Of course they had also the opportunity to obtain a precision estimate via binomial distribution, without the burden of all that calculations. But then the random number generator had to be ideal. BTW: Both Laszlos recommend to use PowerTOST if they were asked . — Regards, Detlew |
mittyri ★★ Russia, 2017-12-08 23:56 (2615 d 08:04 ago) @ d_labes Posting: # 18048 Views: 14,864 |
|
Dear Detlew, thank you for clarification I tried to figure out the precision of PowerTOST estimations with the following code:
library("ggplot2") please correct if it is wrong. The resulted plot: BAsed on the mean and se calculated from sd and n=20 I would say that sample mean 80% in PowerTOST is a real unfortune ❝ BTW: Both Laszlos recommend to use PowerTOST if they were asked . — Kind regards, Mittyri |
Helmut ★★★ Vienna, Austria, 2017-12-09 18:00 (2614 d 14:00 ago) @ mittyri Posting: # 18049 Views: 14,855 |
|
Hi mittyri, ❝ I tried to figure out the precision of PowerTOST estimations with the following code: ❝ ❝ ❝ ❝ please correct if it is wrong. I think so. You got the right answer to a wrong question. For theta0=0.95 and targetpower=0.8 sample sizes are 57 for design="2x3x3" and 56 for design="2x2x3" . Therefore, with 54 power will be <0.8 for both designs:
❝ […] I would say that sample mean 80% in PowerTOST is a real unfortune On the contrary; fortunately works as designed with the right sample sizes. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
mittyri ★★ Russia, 2017-12-09 22:05 (2614 d 09:55 ago) @ Helmut Posting: # 18050 Views: 14,820 |
|
Hi Helmut, sorry if my thoughts were unclear in previous post. As Astea has noted, 2 Laszlos in their paper estimated the required minimum sample size as 54 subjects for "2x3x3" design (CV=0.8, theta0=0.95). They claimed that "The precision of the estimation was evaluated by running the simulations twenty times". My question was: is it possible for PowerTOST? Is it possible to get the mean power of 80% using the mean of 20 runs?
library("ggplot2") So the answer is: yes, that's possible, but you need to be unlucky (the probability is about 7%) — Kind regards, Mittyri |
Astea ★★ Russia, 2017-12-10 01:10 (2614 d 06:49 ago) @ mittyri Posting: # 18051 Views: 14,823 |
|
Dear All! Thank you for clarifying this question! Interesting consequences! How much time did you spend on plotting with 1E6 reps? My comp hanged over when I tried to get more than 1E4... ❝ So the answer is: yes, that's possible, but you need to be unlucky (the probability is about 7%) For 72 subjects and theta0=0.9 we get even worser: 98.21 are less than 0.8 (checked with 104 reps).— "Being in minority, even a minority of one, did not make you mad" |
Helmut ★★★ Vienna, Austria, 2017-12-10 21:27 (2613 d 10:33 ago) @ Astea Posting: # 18052 Views: 14,897 |
|
Hi Astea, ❝ How much time did you spend on plotting with 1E6 reps? My comp hanged over when I tried to get more than 1E4... 2:15 hours on my 2½ years old CPU for 1e5 rep’s × nsims=1e5 – since this is the default in power.scABEL() .— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
Astea ★★ Russia, 2017-12-10 22:13 (2613 d 09:47 ago) @ Helmut Posting: # 18053 Views: 14,856 |
|
Dear Helmut! ❝ 2:15 hours on my 2½ years old CPU for 1e5 rep’s × — "Being in minority, even a minority of one, did not make you mad" |
pjs ★ India, 2018-02-09 14:08 (2552 d 17:51 ago) @ Helmut Posting: # 18388 Views: 13,413 |
|
Hi All, ❝ If you want to go with reference-scaling, none! They depend on the CVwR and are obtained in the actual study. Hence, you need simulations, where your assumed CVwR is the mean. Either use the tables provided by the two Lászlós* or package For sample size estimation for highly variable drugs, simulations are required to estimate sample size. Just wondering what parameters/variables are applied in the simulations being done like wise in the sample size suggested by Laszlo or by package powertost, Also what could be impact of difference in variable assumption for simulation incase of borderline high and very large variability (like 30% and 300%), varying T/R ratios (100%, 80.01%) etc. Regards pjs |
Helmut ★★★ Vienna, Austria, 2018-02-09 21:15 (2552 d 10:45 ago) @ pjs Posting: # 18391 Views: 13,547 |
|
Hi pjs, ❝ For sample size estimation for highly variable drugs, simulations are required to estimate sample size. Correct. ❝ Just wondering what parameters/variables are applied in the simulations being done like wise in the sample size suggested by Laszlo or by package powertost, Try the respective functions sampleN.RSABE() for the FDA’s reference-scaling and sampleN.scABEL() for the EMA’s and Health Canada’s average bioequivalence with expanding limits in PowerTOST . Both functions are extensively documented. In the R-console after typing library(PowerTOST) try help(sampleN.RSABE) or help(sampleN.scABEL) .László Tóthfalusi’s code (in MatLab) is not available in the public domain. It is slow (therefore, only 10,000 simulations) and for years the two Lászlós recommend PowerTOST instead. ❝ Also what could be impact of difference in variable assumption for simulation incase of borderline high and very large variability (like 30% and 300%), With high (say >50%) CwR the GMR-restriction (80.00% ≤ GMR ≤ 125.00%) precedes over the CI-decision. At CVwR 300% practically only the GMR is important (esp. for RSABE). ❝ varying T/R ratios (100%, … Never, ever assume a T/R-ratio of 100%. It will strike back when the study fails with a too low sample size. We recommend 90% at the best. ❝ … 80.01%) That’s for CVwR ≤30% (no scaling) almost simulating the Type I Error (assuming true Null). Would be at 80%. Try
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |