HVD Pilot: 3 candidates, 1 reference [Design Issues]
❝ Can you please elaborate about this uncertainity more? Where is it coming from? Can you reference this weirdo's paper if possibile?
Let us say you do a pilot trial with two test products and one Ref. in N=12 subjects.
For T1 versus R you get a 90% CI of 91.76%-118.23% for a metric of interest, like Cmax or AUCt.
For T2 versus R you get a 90% CI of 88.33%-114.99%.
One might be inclined to think that T2 is the better match. The numbers above would suggest it since PE is closer to one for T2 than for T1, right? So perhaps you select T2 as the candidate formulation for the pivotal trial. But it turns out that this selection is associated with a lot of uncertainty.
- T1 may actually be a lot better than T2; even if the figures above suggest the opposite. The probability of this being the case can't be worked out from the figures (but trust me, it is regularly unpleasantly high)
- The figures above suggest that T1 versus R has a GMR of 104.2% while T2 versus R has a GMR of 100.8%.
It all comes down to the true performance of T1 and T2 versus R. This is the one thing you will not know, ever. I used the terms "high" and "a lot" above; if you tell me the true performance CV and GMR of T1 versus R, and T2 versus R, then I will be happy to quantitatively define "high" and "a lot".
In essence, such issues are described here and here.
These papers will give you an idea of making the wrong decision if you try to select one out of two.
Pass or fail!