Outlier tests: forget it!....what if.... [Bioanalytics]

posted by moblak – 2010-01-25 11:04 (5997 d 07:24 ago) – Posting: # 4644
Views: 9,255

Dear all,

A very interesting topic!

Could someone please comment the extreme example explained below:

During the study, we normally have 2 QC replicates at three diff. QC levels for each run.
Our QC acceptance criteria for each run: at least 4/6 of all QCs and 1/2 QCs at each level must be within ±15% of the nominal concentration (%Bias).
In addition, we have a during-study acceptance criteria for all QCs at each level: %CV<15% and %Nominal 100±15%.

Now the »extreme« example; nearly »ideal« method… a study of 50 subjects….50 runs…. 100 QCs at each level
49 runs…. all QCs at each level have %Nominal of 100%

1 run… 5 QCs 100% Nominal and one QC at level 1 300% Nominal (run is accepted)

During the investigation of this run you don't find any analytical reason to exclude »300%QC« (chromatography OK, IS response consistent,….) … you suspect a possible sample switch or problem (contamination?) during extraction…but you can't prove that.

All runs within study are accepted according to the 4/6 and 1/2 rule; however, if we calculate %CV and %Bias, we get the following results:
QC level 1      %CV=20(19.6);  %Nominal=102     (not acceptable)
QC level 2      %CV=0;          %Nominal=100
QC level 3      %CV=0;          %Nominal=100


According to the FDA guidelines (“Summary information on intra- and inter-assay values of QC samples and data on intra- and inter-assay accuracy and precision from calibration curves and QC samples used for accepting the analytical run.“), this nearly “ideal” method would be unsuitable due to only one out of 300 QCs failing really badly.
But is this method really not OK?

In general I agree with “no outliers policy”, but on the other hand, FDA “allows” some sort of the outliers: “Reported method validation data and the determination of accuracy and precision should include all outliers; however, calculations of accuracy and precision excluding values that are statistically determined as outliers can also be reported.

If the “300%QC” would be rejected as an outlier, the method would become ideal.

Any ideas?


Regards
Marko

p.s. I tried to write it shorter, but I just couldn’t manage it.

Complete thread:

UA Flag
Activity
 Admin contact
23,655 posts in 4,993 threads, 1,571 registered users;
387 visitors (0 registered, 387 guests [including 16 identified bots]).
Forum time: 19:29 CEST (Europe/Vienna)

Don’t compromise yourself.
You are all you’ve got.    Janis Joplin

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5