Type I error inflation caused by batch-to-batch variability of Reference? [Design Issues]
Hi David,
you raised good points!
Yep. At least the EMA’s BE-GL specifically asks for products which are “similar” in their measured content (Δ ≤5%). Of course – due to inaccuracy/imprecision of the analytical method – even “suitable” batches might have a larger true difference. However, this will not affect the Type I Error – only increases the producer’s risk; Type II Error).
Is the risk for a patient to switch from Reference to Test substantially larger than between different batches of the reference (which happens all the time)? Duno. Educated guess: No.*
We must not forget that batch-to-batch variability (if theoretically tested in BE studies powered at 80%) will lead to failure in 1/5 of studies. And: Failure to demonstrate BE does not imply inequivalence.
IIRC, at the BioInternational ’94 (Munich) Les Benet suggested small (n=6) BE-studies evaluated by Bayesian methods for batch-release. Was not further considered due to the shouts of innovators.
you raised good points!
❝ Batch-to-batch variability is "random noise" imo, …
Yep. At least the EMA’s BE-GL specifically asks for products which are “similar” in their measured content (Δ ≤5%). Of course – due to inaccuracy/imprecision of the analytical method – even “suitable” batches might have a larger true difference. However, this will not affect the Type I Error – only increases the producer’s risk; Type II Error).
Is the risk for a patient to switch from Reference to Test substantially larger than between different batches of the reference (which happens all the time)? Duno. Educated guess: No.*
We must not forget that batch-to-batch variability (if theoretically tested in BE studies powered at 80%) will lead to failure in 1/5 of studies. And: Failure to demonstrate BE does not imply inequivalence.
IIRC, at the BioInternational ’94 (Munich) Les Benet suggested small (n=6) BE-studies evaluated by Bayesian methods for batch-release. Was not further considered due to the shouts of innovators.

- Davit BM, Nwakama PE, Buehler GJ, Conner DP, Haidar SH, Patel DT, Yang Y, Yu LX, Woodcock J. Comparing Generic and Innovator Drugs: A Review of 12 Years of Bioequivalence Data from the United States Food and Drug Administration. Ann Pharmacother. 2009; 43(10): 1583-97. doi:10.1345/aph.1M141.
—
Dif-tor heh smusma 🖖🏼 Довге життя Україна!![[image]](https://static.bebac.at/pics/Blue_and_yellow_ribbon_UA.png)
Helmut Schütz
![[image]](https://static.bebac.at/img/CC by.png)
The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Dif-tor heh smusma 🖖🏼 Довге життя Україна!
![[image]](https://static.bebac.at/pics/Blue_and_yellow_ribbon_UA.png)
Helmut Schütz
![[image]](https://static.bebac.at/img/CC by.png)
The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Complete thread:
- Type I error inflation caused by batch-to-batch variability of Reference? nobody 2016-10-20 10:00
- Type I error inflation caused by batch-to-batch variability of Reference? Dr_Dan 2016-10-20 12:06
- Type I error inflation caused by batch-to-batch variability of Reference? nobody 2016-10-20 12:14
- Type I error inflation caused by batch-to-batch variability of Reference? Dr_Dan 2016-10-20 12:20
- Type I error inflation caused by batch-to-batch variability of Reference? nobody 2016-10-20 12:27
- Type I error inflation caused by batch-to-batch variability of Reference? Dr_Dan 2016-10-20 12:49
- Type I error inflation caused by batch-to-batch variability of Reference? nobody 2016-10-20 14:27
- Type I error inflation caused by batch-to-batch variability of Reference? Dr_Dan 2016-10-20 12:49
- Type I error inflation caused by batch-to-batch variability of Reference? nobody 2016-10-20 12:27
- Type I error inflation caused by batch-to-batch variability of Reference? DavidManteigas 2016-10-21 10:44
- Type I error inflation caused by batch-to-batch variability of Reference?Helmut 2016-10-24 17:12
- Type I error inflation caused by batch-to-batch variability of Reference? Dr_Dan 2016-10-20 12:06
