## HVD Pilot: 3 candidates, 1 reference [Design Issues]

Hello Lukamar,

» Can you please elaborate about this uncertainity more? Where is it coming from? Can you reference this weirdo's paper if possibile?

Let us say you do a pilot trial with two test products and one Ref. in N=12 subjects.

For T1 versus R you get a 90% CI of 91.76%-118.23% for a metric of interest, like Cmax or AUCt.

For T2 versus R you get a 90% CI of 88.33%-114.99%.

One might be inclined to think that T2 is the better match. The numbers above would suggest it since PE is closer to one for T2 than for T1, right? So perhaps you select T2 as the candidate formulation for the pivotal trial. But it turns out that this selection is associated with a lot of uncertainty.

It all comes down to the

In essence, such issues are described here and here.

These papers will give you an idea of making the wrong decision if you try to select one out of two.

» Can you please elaborate about this uncertainity more? Where is it coming from? Can you reference this weirdo's paper if possibile?

Let us say you do a pilot trial with two test products and one Ref. in N=12 subjects.

For T1 versus R you get a 90% CI of 91.76%-118.23% for a metric of interest, like Cmax or AUCt.

For T2 versus R you get a 90% CI of 88.33%-114.99%.

One might be inclined to think that T2 is the better match. The numbers above would suggest it since PE is closer to one for T2 than for T1, right? So perhaps you select T2 as the candidate formulation for the pivotal trial. But it turns out that this selection is associated with a lot of uncertainty.

- T1 may actually be a lot better than T2; even if the figures above suggest the opposite. The probability of this being the case can't be worked out from the figures (but trust me, it is regularly unpleasantly high)

- The figures above suggest that T1 versus R has a GMR of 104.2% while T2 versus R has a GMR of 100.8%.

It all comes down to the

**true**performance of T1 and T2 versus R. This is the one thing you will not know, ever. I used the terms "high" and "a lot" above; if you tell me the true performance CV and GMR of T1 versus R, and T2 versus R, then I will be happy to quantitatively define "high" and "a lot".In essence, such issues are described here and here.

These papers will give you an idea of making the wrong decision if you try to select one out of two.

—

Pass or fail!

ElMaestro

Pass or fail!

ElMaestro

### Complete thread:

- HVD Pilot: 3 candidates, 1 reference Shah 2021-07-16 13:40 [Design Issues]
- HVD Pilot: 3 candidates, 1 reference ElMaestro 2021-07-16 13:51
- HVD Pilot: 3 candidates, 1 reference lukamar 2021-07-20 08:54
- HVD Pilot: 3 candidates, 1 referenceElMaestro 2021-07-20 09:31

- HVD Pilot: 3 candidates, 1 reference lukamar 2021-07-20 08:54

- HVD Pilot: 3 candidates, 1 reference ElMaestro 2021-07-16 13:51