## Οὐτοπεία ∨ Εὐτοπεία [RSABE / ABEL]

Hi Nastia

» […] I have some doubts in logical equality of the inflation of TIE and consumer's risk. Can you please explain my faults in the following reasoning?

»

» Suppose we expect drug A to be highly variable (in the previous study somewhere in Antarctica W. Oodendijk et al. have got CV>30% for the reference drug).

The problem starts already here. How reliable is Oodendijk’s result? Is it the only one? Did the agency agree that the drug is HV and wider limits can be used?

» Which of the following options should we prefer to write in the protocol in order to care of the customer:

»

» a). Use pre-specified wider limits 75-133 for C

» b). Use the GCC-GL approach (inflation up to 21%?)

The crucial point is what we consider a

$$\small{\Delta=20\%\implies\left\{\theta_1=80.00\%,\,\theta_2=125.00\%\right\}}\tag{1}$$ $$\small{\Delta=25\%\implies\left\{\theta_1=75.00\%,\,\theta_2=133.3\dot{3}\%\right\}}\tag{a}$$ $$\small{\Delta\: \overset{{\color{Red} ?}}{\rightarrow}\,\begin{vmatrix}

\widehat{CV_\textrm{wR}}\leq30\%\rightarrow \Delta=20\%\\

\widehat{CV_\textrm{wR}}>30\%\rightarrow \Delta=25\%

\end{vmatrix}\implies\begin{Bmatrix}

\theta_1=80.00\%,\,\theta_2=125.00\%\\

\theta_1=75.00\%,\,\theta_2=133.3\dot{3}\%

\end{Bmatrix}}\tag{b}$$ \(\small{(1)}\) and \(\small{(\textrm{a})}\) are straightforward. Fixed limits, type I error always ≤ the nominal \(\small{\alpha}\).

\(\small{(\textrm{b})}\) is

» Suppose that at the end of the trial we get CV≤30% and CI within 75-133, but out of 80-125.

» Then for the a-approach we should conclude the drug BE, …

If (a) was stated in the protocol and accepted by the agency, fine. The CV is interesting though not relevant. Try the function

» … for the b-approach - fail to conclude BE.

No risk, no fun.

» That is the risk of the customer to get a bad product is higher in the first approach if we define "a bad product" as a non-HVD with the limits out of 80-125.

Nope. In (a) you accept

» The difference is in the fact that in the first approach we proclaim the drug to be good if it is within the limits 75-133.

Correct.

» Until about 2013 there were a lot of studies in Russia with 75-133 limits for C

Interesting. However:

» […] I have some doubts in logical equality of the inflation of TIE and consumer's risk. Can you please explain my faults in the following reasoning?

»

» Suppose we expect drug A to be highly variable (in the previous study somewhere in Antarctica W. Oodendijk et al. have got CV>30% for the reference drug).

The problem starts already here. How reliable is Oodendijk’s result? Is it the only one? Did the agency agree that the drug is HV and wider limits can be used?

» Which of the following options should we prefer to write in the protocol in order to care of the customer:

»

» a). Use pre-specified wider limits 75-133 for C

_{max}(no inflation?)» b). Use the GCC-GL approach (inflation up to 21%?)

The crucial point is what we consider a

*“clinically not relevant \(\small{\Delta}\)”*. Muse a bit on these goodies:$$\small{\Delta=20\%\implies\left\{\theta_1=80.00\%,\,\theta_2=125.00\%\right\}}\tag{1}$$ $$\small{\Delta=25\%\implies\left\{\theta_1=75.00\%,\,\theta_2=133.3\dot{3}\%\right\}}\tag{a}$$ $$\small{\Delta\: \overset{{\color{Red} ?}}{\rightarrow}\,\begin{vmatrix}

\widehat{CV_\textrm{wR}}\leq30\%\rightarrow \Delta=20\%\\

\widehat{CV_\textrm{wR}}>30\%\rightarrow \Delta=25\%

\end{vmatrix}\implies\begin{Bmatrix}

\theta_1=80.00\%,\,\theta_2=125.00\%\\

\theta_1=75.00\%,\,\theta_2=133.3\dot{3}\%

\end{Bmatrix}}\tag{b}$$ \(\small{(1)}\) and \(\small{(\textrm{a})}\) are straightforward. Fixed limits, type I error always ≤ the nominal \(\small{\alpha}\).

\(\small{(\textrm{b})}\) is

*data-driven*(like ABEL and RSABE), since it depends on the*estimated*\(\small{CV_\textrm{wR}}\). The Null-hypothesis is like Schrödinger’s cat – or Wigner’s friend, if you prefer. The study (not based on clinical grounds by the applicant and regulator like in \(\small{(1)}\) and \(\small{(\textrm{a})}\)) “decides” which \(\small{\Delta}\) is acceptable for the patient. That’s not a particularly good idea. By definition (‼)*any*framework (or a pre-test) might lead to a false decision and hence, inflates the TIE. That’s a multiplicity problem, which – if not adjusted – will increase the familywise error rate.» Suppose that at the end of the trial we get CV≤30% and CI within 75-133, but out of 80-125.

» Then for the a-approach we should conclude the drug BE, …

If (a) was stated in the protocol and accepted by the agency, fine. The CV is interesting though not relevant. Try the function

`CVCL()`

in `PowerTOST`

. Might be pure chance (well include >30%).» … for the b-approach - fail to conclude BE.

No risk, no fun.

» That is the risk of the customer to get a bad product is higher in the first approach if we define "a bad product" as a non-HVD with the limits out of 80-125.

Nope. In (a) you accept

*beforehand*that \(\small{\Delta=25\%}\) is not relevant for the patient. But again: You don’t assess the CV at all. Maybe it*is*HV indeed (like in Antarctica).» The difference is in the fact that in the first approach we proclaim the drug to be good if it is within the limits 75-133.

Correct.

» Until about 2013 there were a lot of studies in Russia with 75-133 limits for C

_{max}even for non-HVD drugs.Interesting. However:

`library(PowerTOST)`

CVCL(CV = 0.27, df = 3*40-4, side ="2-sided") # 4-period full replicate, n = 40

lower CL upper CL

0.2383666 0.3116013

—

Helmut Schütz

The quality of responses received is directly proportional to the quality of the question asked. 🚮

Science Quotes

*Dif-tor heh smusma*🖖Helmut Schütz

The quality of responses received is directly proportional to the quality of the question asked. 🚮

Science Quotes

### Complete thread:

- Inflated type I error with fixed widened limits? Helmut 2020-11-25 10:50 [RSABE / ABEL]
- Inflated type I error with fixed widened limits? d_labes 2020-11-25 15:07
- Inflated type I error with fixed widened limits? Helmut 2020-11-26 00:09
- Inflated type I error with fixed widened limits d_labes 2020-11-26 15:38
- Inflated type I error: Not nice Helmut 2020-11-26 17:14
- Power of the GCC framework and power of PowerTOST d_labes 2020-11-28 11:20
- Sample sizes (ignoring the inflated TIE) Helmut 2020-11-29 11:21

- Power of the GCC framework and power of PowerTOST d_labes 2020-11-28 11:20

- Inflated type I error: Not nice Helmut 2020-11-26 17:14

- Inflated type I error with fixed widened limits d_labes 2020-11-26 15:38

- Inflated type I error with fixed widened limits? Helmut 2020-11-26 00:09
- Inflated type I error with fixed widened limits? wienui 2020-11-29 14:03
- Inflated type I error with fixed widened limits d_labes 2020-11-29 17:51
- Inflated type I error with fixed widened limits Helmut 2020-11-30 00:14
- Inflated type I error with fixed widened limits wienui 2020-11-30 03:30
- Houston, we have a problem! Helmut 2020-11-30 14:42
- Paradox of tolerance Astea 2020-12-01 23:34
- Οὐτοπεία ∨ ΕὐτοπείαHelmut 2020-12-02 01:37
- Uchronia Astea 2020-12-02 09:46
- Steampunk Helmut 2020-12-02 11:34
- Dieselpunk Astea 2020-12-02 15:28
- Dieselpunk Helmut 2020-12-02 16:18

- Steampunk? OT d_labes 2020-12-02 19:30
- Steampunk? OT Astea 2020-12-02 19:58

- Dieselpunk Astea 2020-12-02 15:28

- Steampunk Helmut 2020-12-02 11:34

- Uchronia Astea 2020-12-02 09:46

- Οὐτοπεία ∨ ΕὐτοπείαHelmut 2020-12-02 01:37

- Paradox of tolerance Astea 2020-12-01 23:34
- PowerTOST 1.5-2.9000 on GitHub Helmut 2020-12-23 12:18

- Houston, we have a problem! Helmut 2020-11-30 14:42

- Inflated type I error with fixed widened limits wienui 2020-11-30 03:30

- Inflated type I error with fixed widened limits Helmut 2020-11-30 00:14

- Inflated type I error with fixed widened limits d_labes 2020-11-29 17:51

- Inflated type I error with fixed widened limits? d_labes 2020-11-25 15:07