So you made a baseline correction and now the team discusses ANCOVA [General Sta­tis­tics]

posted by Relaxation  – Germany, 2018-02-13 16:37 (2256 d 23:54 ago) – Posting: # 18414
Views: 5,460

Hello everybody.

Because I was A) not able to find any post that even remotely dealed with this issue and B) had some discussion lately that might also betide anybody else and C) have some spare time and D) was bewildered that this issue caused so much discussion, I would like to show a simple example why in BE/BA the fancy stuff is not necessarily the correct approach.
May be boring for the experienced biometrician/statistician, but was enlightening for a lot of my colleagues.
Remember, you can stop reading at any time, just saying :-D.

We got involved in discussing the evaluation of an endogenous substance (including a pre-dose profile for baseline correction), where we criticized that no baseline correction was implemented at all and, therefore, their conclusion on the compared products was not valid :no:.
But people said, an ANCOVA was used, as recommended by the "Guideline on adjustment for baseline covariates in clinical trials", so this approach should suffice as a baseline correction.

From our point of view, this is not correct; as as a matter of fact, the use of a covariate should be considered if there actually is some impact of the starting value on the outcome. Likely fine for clinical endpoints and some PD parameters, but what should be the mechanistical concept in case of an AUC?
:ponder:

So, we did not agree and were able to enforce a "proper" baseline correction by subtraction. This was finally implemented and ... resulted in the exact same results :confused:. By closer examination it was revealed that the same model was applied, i.e. the ANCOVA was conducted considering the values after baseline-correction. Nice try...

As a little illustration to be used when such a discussion comes up consider these values:
Subject Treat Base Measure
   1      T    10    100
   1      R     0     50
   2      T    12    110
   2      R     0     45
   3      T     8     90
   3      R     0     55
   4      T    14    105
   4      R     0     60
   5      T     6     95
   5      R     0     40


Easy to see, we have a pure difference of 50 for T-R and 40 if baseline is considered. Hint: these are not real data.

Now, whatever software you use, the evaluation should resemble something like this:
(if SAS: PROC GLM DATA=XXX;)
CLASS Treatment Subject;
MODEL Result=Treatment Subject Baseline

where "Baseline" is used in case of inclusion of the covariate.
So what results do we get in which evalution (point estimates and 95%CI):
Raw values:                50 ( 36- 64)
ANCOVA:                    45 (-22-112)
Baseline corrected values: 40 ( 26- 54)
ANCOVA:                    45 (-22-112)

As you can see, use of the ANCOVA approach gives us results differing from what we get from the "expected" calculation. And as is to be expected due to the concept of an ANOVA it does not matter, whether you use the change from baseline or the end value. So, in particular in those cases, where officially the baseline-correction in accordance with the guidelines was implemented, but an ANCOVA was conducted...).
And good luck finding a medical writer who will recognize this in the SAS code or Phoenix output or...

Why is this important? Well, in the case that started our discussion, the improper ANOVA shifted the point estimate and allowed to conclude on a statistically significant difference. That is, it allowed to avoid crossing the 100% threshold. Could have been 125% as well.
In the presented case above on the other hand, the improper ANCOVA markedly increased the variance (the baseline values are admittedly a little bit one-sided), so hiding a difference might be possible.

As always, please do not hesitate to correct, add and challenge, if there is something wrong.

Best regards,

Relaxation.


Edit: Tabulators changed to spaces and BBcoded; see also this post #6. [Helmut]

Complete thread:

UA Flag
Activity
 Admin contact
22,987 posts in 4,824 threads, 1,665 registered users;
94 visitors (1 registered, 93 guests [including 8 identified bots]).
Forum time: 17:32 CEST (Europe/Vienna)

The only way to comprehend what mathematicians mean by Infinity
is to contemplate the extent of human stupidity.    Voltaire

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5