Astea
★★  

Russia,
2016-04-11 12:33
(3270 d 00:34 ago)

Posting: # 16182
Views: 5,980
 

 Missing data analyses [Regulatives / Guidelines]

Dear all!

Recently I've received a letter from the Customer where it was pointed out that according to the planning regulatory documents we have to include missing data in analyses in a very specific way. For example in several cases the missing data from one volunteer in one period should be replaced be the mean arithmetic of the other's data.

Of course this method has a right to exist. It was described in European Pharmacopeia 5.0 p.3.2.6 and in several articles, but it seems to me very strange to use this technic in bioequivalence data analyses.:confused:

Looking forward for your points of view!

"Being in minority, even a minority of one, did not make you mad"
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2016-04-11 15:13
(3269 d 21:54 ago)

@ Astea
Posting: # 16183
Views: 5,130
 

 Data imputation

Hi Astea,

❝ Recently I've received a letter from the Customer where it was pointed out that according to the planning regulatory documents we have to include missing data in analyses in a very specific way.


You posted in the category Regulatives / Guidelines. What do you mean by “planning regulatory documents”?

❝ For example in several cases the missing data from one volunteer in one period should be replaced be the mean arithmetic of the other's data.


That’s bizarre. Practically all regulatory documents point out that common PK metrics (except tmax) are assumed to follow a lognormal distribution. Hence, we apply a multiplicative model (log-transformation in order to obtain additive effects). Arithmetic mean is wrong.

❝ Of course this method has a right to exist.


Don’t think so.

❝ It was described in European Pharmacopeia 5.0 p.3.2.6 and in several articles, but it seems to me very strange to use this technic in bioequivalence data analyses. :confused:


The technical term is “imputation”. It is common in clinical studies if a patient drops out midcourse (i.e., Last-Observation-Carried-Forward – LOCF). Here it can be (!) conservative since in a superiority test the estimated mean difference will me smaller and if one assumes that the treatment performs better than placebo. But it is not that easy. ICH E9 states in Section 5.3:

Unfortunately, no universally applicable methods of handling missing values can be recommended.


I never ever have seen it in BE and for good reasons. If you impute the missing by the geometric (!) mean of the other subjects:
  • The between-subject variance likely will be lower than the one of the dataset before imputation.
  • The T/R-ratio will be biased to an unknown degree.
  • The SE of the difference might be lower as well. Hence such a comparison might be anticonservative.
If you want to work with an incomplete data set (i.e., missing period(s)) you can try a mixed effects-model. See this rather lengthy discussion of the issue.
BTW, the EMA’s GL wants only complete subjects (T and R) in simple crossovers and at least one period with each of T and R in replicate designs. Both the EMA’s and the FDA’s SAS-code for reference-scaling drop incomplete subjects.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Astea
★★  

Russia,
2016-04-11 19:53
(3269 d 17:14 ago)

@ Helmut
Posting: # 16185
Views: 5,039
 

 Data imputation

Dear Helmut!

Sorry for wasting your time on such a question, I was totally confused by that letter.

❝ You posted in the category Regulatives / Guidelines. What do you mean by “planning regulatory documents”?


I meant Eurasian economical commission, but there are no information about missing data in that document. The above statement about data replacement was made during one of the seminars deducated to the acception of the new rules.

❝ That’s bizarre.


I totally agree that it is impossible to use it in BE studies. Just wanted to get the link on the documentation where it should be stated that it is incorrect. Suppose it was somebody's invention...

❝ BTW, the EMA’s GL wants only complete subjects (T and R) in simple crossovers and at least one period with each of T and R in replicate designs. Both the EMA’s and the FDA’s SAS-code for reference-scaling drop incomplete subjects.


That's what I do. Just to get sure I interpreted correctly..

"Being in minority, even a minority of one, did not make you mad"
Hutchy_7
☆    

UK,
2016-04-12 15:38
(3268 d 21:29 ago)

@ Astea
Posting: # 16187
Views: 4,924
 

 Missing data analyses

Impeccable timing as have just had a very similar situation arise myself that I would be extremely grateful for any input on:

I have been scouring the relevant EMA/FDA guidance but haven’t come across anything too useful in relation to assessing the impact of missing samples in a bioequivalence study.

The scenario is:

4 way cross BE study; test vs ref in fed and fasted states

N = 22 HVs

Tmax ~60 mins
T1/2 ~120 min

Sampling: 0, 10, 15, 20, 30, 40, 50, 60, 70, 80, 90, 105, 120, 180, 240, 360, 480 and 720 mins

During one of the study periods a protocol non-compliance has resulted in the 480 min time point not being available for 2 out of 22 subjects.

Given where the 480 h time point lies in the profile, my instinct tells me that the missing samples should have minimal/negligible impact on the study objectives (i.e. to test for bioequivalence) and should not introduce an unacceptable amount of bias into the estimation of AUCt for the 2 subjects in question.

However, I would like to check if there are any guidelines/best practices etc that reinforce my ‘instinct’?

Any thoughts most welcome!
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2016-04-12 16:06
(3268 d 21:01 ago)

@ Hutchy_7
Posting: # 16188
Views: 4,967
 

 Missing sample(s)

Hi Hutchy,

welcome to the BEBA-Forum!

❝ I have been scouring the relevant EMA/FDA guidance but haven’t come across anything too useful in relation to assessing the impact of missing samples in a bioequivalence study.


Correct. A weak point of a guideline which was written in order to serve as a kind of “cookbook”.

❝ During one of the study periods a protocol non-compliance has resulted in the 480 min time point not being available for 2 out of 22 subjects.

❝ Given where the 480 h time point lies in the profile, my instinct tells me that the missing samples should have minimal/negligible impact on the study objectives (i.e. to test for bioequivalence) and should not introduce an unacceptable amount of bias into the estimation of AUCt for the 2 subjects in question.


I agree with what your ‘instinct’ tells you.

❝ However, I would like to check if there are any guidelines/best practices etc that reinforce my ‘instinct’?


Which trapezoidal method did you state in the protocol? With the linear-up/logarithmic-down trapezoidal the impact of a missing sample in the elimination phase will be negligible. With the (IMHO outdated) linear trapezoidal you will get a small positive bias (i.e., AUC overestimated). See also this rather lengthy thread.

I’m not aware of any current guideline recommending a particular method. The WHO’s GL (2006) stated “The method of calculating AUC-values should be specified. In general AUC should be calculated using the linear/log trapezoidal integration method.” The second sentence was dropped in the current (2015) version for unfathomable reasons.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
Hutchy_7
☆    

UK,
2016-04-12 17:29
(3268 d 19:38 ago)

@ Helmut
Posting: # 16190
Views: 4,879
 

 Missing sample(s)

Thanks for the response Helmut, very much appreciated!
UA Flag
Activity
 Admin contact
23,409 posts in 4,921 threads, 1,708 registered users;
22 visitors (0 registered, 22 guests [including 4 identified bots]).
Forum time: 12:08 CET (Europe/Vienna)

It’s easy to lie with statistics;
it is easier to lie without them.    Frederick Mosteller

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5