preyes323 ☆ 2010-07-12 19:12 (5422 d 03:08 ago) Posting: # 5608 Views: 15,473 |
|
Hi, I am currently studying on Pharmacokinetic Analysis. My teacher gave me a sample Cmax Data for use in studying. I was tasked to compute for the bioequivalence using the protocol in this link: FDA Draft Guideline I got the following values for the reference variability and CI. reference = 0.378573 CI = 34.55646 According to him these are the wrong values. It should have been 0.452 and -0.16794 respectively. I have tried recomputing it a number of times already. I also used the SAS code as indicated in the guide. Am I missing something? Is there supposed to be some other implied computation that I am not doing? Below is a link to some of the files I have used for computation as well as the sample data he gave. Thank you very much in advance to anyone who can help me. Thanks and Regards, Paolo Cmax Reference Variability.zip |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-12 19:26 (5422 d 02:54 ago) @ preyes323 Posting: # 5609 Views: 14,305 |
|
Dear Paolo! I'm not gifted with ![]() ![]() Can you post the entire stuff? — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
preyes323 ☆ 2010-07-12 20:20 (5422 d 02:00 ago) @ Helmut Posting: # 5610 Views: 14,341 |
|
Hi, Thanks for the quick reply. Here is the link to the datasets and codes I used. Datasets.zip Thanks, Paolo Edit: Full quote removed. Please delete anything from the text of the original poster which is not necessary in understanding your answer; see also this post! [Helmut] |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-12 20:38 (5422 d 01:43 ago) @ preyes323 Posting: # 5611 Views: 14,499 |
|
Dear Paolo! ❝ Here is the link to the datasets and codes I used. OK, with SAS' native binary data format you are leaving everybody without SaS out in the rain. ![]() Can you please upload data as SAS Transport Files ( *.xpt ) - which can be imported by (some) other statistical software, or - even better - in Character Separated Format (*.csv )?— Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
preyes323 ☆ 2010-07-13 03:16 (5421 d 19:05 ago) @ Helmut Posting: # 5612 Views: 14,333 |
|
Hi, I am very sorry for that. Attached are the datasets again, this time with the *.xpt file type. Thanks, Paolo (2) Datasets.zip Edit: Full quote removed. Please delete anything from the text of the original poster which is not necessary in understanding your answer; see also this post! [Helmut] |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-13 04:29 (5421 d 17:51 ago) @ preyes323 Posting: # 5613 Views: 14,511 |
|
Dear Paolo! Had a quick look in Phoenix6.1 (average BE, too late to get FDA's model running). Fixed: SEQUENCE+TREATMEN+PERIOD Repeated Specification: PERIOD Variance Blocking Variables (Subject): SUBJECT Group: TREATMEN Type: Variance Components Random Effects: TREATMEN Variance Blocking Variables (Subject): SUBJECT Type: Banded No-Diagonal Factor Analytic (f) Number of factors (f): 2 I got: Warning 11091: Newton's algorithm converged with modified Hessian. Output is suspect. and sigma²WR 0.1861995 (CVWR 0.452397) If I try IBE/PBE I got: *** WARNING 11121: Subject X had incomplete design and was discarded. X in the warning above is the ID of all subjects except ones in sequence RRT. That was it. ![]() P.S.: Please delete anything from the text of the original poster which is not necessary in understanding your answer; see also this post! — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-13 14:15 (5421 d 08:06 ago) @ Helmut Posting: # 5615 Views: 14,304 |
|
Dear Helmut! ❝ I got: ❝ ❝ ❝ ❝ and sigma²WR 0.1861995 (CVWR 0.452397) This is the continuation of our earlier discussion: The FDA model (and your specification is some sort of ![]() — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-13 15:42 (5421 d 06:39 ago) @ d_labes Posting: # 5616 Views: 14,257 |
|
Dear D. Labes! ❝ This is the continuation of our earlier discussion: The FDA model ❝ (and your specification is some sort of ❝ extra-reference design. Yes, I know. ![]() I've read exactly this discussion before - but it was too late in the night to start a fight with Phoenix' LinMix Engine, a beast at least as biting as your pet... I found it interesting that ABE's CVWR 0.452397 matched Paolo's teacher's 0.452 (though not sure what he meant by 'reference variability'). I'm hoping Simon will pay us a visit. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-13 17:11 (5421 d 05:10 ago) @ Helmut Posting: # 5618 Views: 14,600 |
|
Dear Helmut! ❝ I found it interesting that ABE's CVWR 0.452397 matched Paolo's ❝ teacher's 0.452 (though I'm not sure what he means by 'reference ❝ variability'). Then you may find this also interesting ![]() Results of Proc MIXED FDA code: ... And just more interesting: Analysis according to D. Brown (EMA) of data under treatment with R only, employing an ANOVA with period, sequence and subject within sequence effects (all fixed): ... (All colors by me). Very near to the MIXED results. But maybe this coincidence is by chance. Note also that this is not the same as the analysis via intra-subject contrasts R1-R2 with s2WR= 0.143318, sWR= 0.378573 (Paolos result), CV=0.392551. But never trust estimates with questionable convergence in REML (WINNONLIN definitely warns at least "Output is suspect", R's lme() will throw an error if not converged and will not give you any parameter estimate or will not give any CI for the covariance parameters if VarCov is not positive definite, but the incredible ![]() ![]() — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-13 21:19 (5421 d 01:01 ago) @ d_labes Posting: # 5620 Views: 14,328 |
|
Dear D. Labes! ❝ ❝ ❝ ❝ ❝ ❝ ❝ OK, I end up after 7 iterations at: -2* REML log(likelihood) 251.724 Same result if use the default convergence criterion (10-10), yours ((10-8), or approach numeric resolution. ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ Closer match than we had in our previous example... Final variance parameter estimates: ❝ And just more interesting: Analysis according to D. Brown (EMA)... ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ ❝ Confirmed.
Total Observations : 88 ❝ Very near to the MIXED results. But maybe this coincidence is by chance. Who knows? ❝ But never trust estimates with questionable convergence in REML (WINNONLIN ❝ definitely warns at least "Output is suspect", R's lme() will throw an error if ❝ not converged and will not give you any parameter estimate or will not give ❝ any CI for the covariance parameters if VarCov is not positive definite, but ❝ the incredible ❝ as if nothing happens Well, if I ask PHX/WNL for intermediate results (besides many pages of Matrazen aka matrices) I got an additional Warning 11090: Asymptotic covariance matrix not computed. Information matrix is deemed singular. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-14 12:41 (5420 d 09:39 ago) @ Helmut Posting: # 5621 Views: 14,374 |
|
Dear Helmut! ❝ OK, I end up after 7 iterations at: ❝ ❝ Same result if use the default convergence criterion (10-10), ❝ yours ((10-8), or approach numeric resolution. Here the results using R's lme(). Code used: model2 <- lme(log(Cmax) ~ tmt + period + sequence, Answer: Linear mixed-effects model fit by REML Ok the random effects parameters can't directly compared, only via th G matrix.
getVarCov(model2) Seems that the difference in intra-subject variability is absorbed by the G matrix, with no loss in the fit (nearly identical -2*LL). Quintessence for scABE using the EMA approach:
-- Widened (EMA) Confusion ![]() Astonishing enough the 95% upper confidence interval of the linearized scABE criterion (µT-µR)2-theta2*sigma2WR = -0.03751 is negative if theta=0.76 (EMA and recommended by Tothfalusi et.al.) and the MOM terms are used, if I calculated right. And this would indicate scABE proven. Tothfalusi et.al. Evaluation of Bioequivalence for Highly Variable Drugs with Scaled Average Bioequivalence Clin. Pharmacokinet. 2009; 48 (11): 725-743 — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-14 15:47 (5420 d 06:33 ago) @ d_labes Posting: # 5624 Views: 14,183 |
|
Dear D. Labes, let's continue! -2 REML log(LikH) AIC BIC ❝ Seems WNL computes different. Hhm; according to Phoenix 1.1 users' Guide:
Widened (EMA) — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-15 14:01 (5419 d 08:19 ago) @ Helmut Posting: # 5635 Views: 14,420 |
|
Dear Helmut, ❝ let's continue! -2 REML log(LikH) AIC BIC ❝ ❝ Seems WNL computes different. Seems SAS computes different. According to the SAS help on Proc MIXED: AIC = -2*LL + 2*d BIC = -2*LL + d*log(n) Here LL denotes the maximum value of the (possibly restricted) log likelihood, d the dimension of the model, and n the number of observations. In SAS 6 of SAS/STAT software, n equals the number of valid observations for maximum likelihood estimation and n-p for restricted maximum likelihood estimation, where p equals the rank of X. In later versions, n equals the number of effective subjects as displayed in the "Dimensions" table, unless this value equals 1, in which case n equals the number of levels of the first random effect you specify in a RANDOM statement. If the number of effective subjects equals 1 and you have no RANDOM statements, n then reverts to the SAS 6 values. For restricted likelihood estimation, d equals q, the effective number of estimated covariance parameters. In SAS 6, when a parameter estimate lies on a boundary constraint, then it is still included in the calculation of d, but in later versions it is not. The most common example of this behavior is when a variance component is estimated to equal zero. For maximum likelihood estimation, d equals q+p. A very concise and clear description of the calculations in SAS 9.2 ![]() Of course the R's lme() values are different from SAS's. The R folks undertake each effort to do things not the <$ineffable$> way ![]() — Regards, Detlew |
d_labes ★★★ Berlin, Germany, 2010-07-13 13:51 (5421 d 08:29 ago) @ preyes323 Posting: # 5614 Views: 14,606 |
|
"Good-Nature and Good-Sense must ever join; To err is human, to forgive divine." Alexander Pope (1688-1744) Hi Paolo, after looking at your data and your ![]()
Hope this helps. BTW: Can you tell us where the data came from? And from where your teacher knows the solution? — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-13 15:45 (5421 d 06:35 ago) @ d_labes Posting: # 5617 Views: 14,257 |
|
Dear D. Labes! ❝ "To err is human, to forgive divine." "To err is human, but to really foul things up requires a computer." (Anonymous in Farmer's Almanac, 1978) — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-13 17:47 (5421 d 04:33 ago) @ Helmut Posting: # 5619 Views: 14,168 |
|
Dear Helmut! This is one for our captain: "To Err is Human, to Arr is Pirate ![]() 19. September each year — Regards, Detlew |
ElMaestro ★★★ Denmark, 2010-07-14 23:03 (5419 d 23:17 ago) @ d_labes Posting: # 5629 Views: 14,068 |
|
Dear d_labes, This is an awesome page. Must immediately update my bookmarks. Who on earth knew that there was a pirate version of Google? And the loveable "Damn ye, yellow-bellied sapsuckers, I'm a better man than all of ye milksops put together" gives me the impression that Blackbeard was aspiring hard to a position in an agency somewhere. Many thanks and best regards, EM. Edit: Ahoy, pirrrate version of Google linked, matey ! [Ohlbe] — Pass or fail! ElMaestro |
preyes323 ☆ 2010-07-14 16:45 (5420 d 05:36 ago) @ d_labes Posting: # 5626 Views: 14,052 |
|
Hi All, Thanks for all the replies. I have lots to catch up on. ![]() ![]() From the comments I am reading, I guess I shouldn't have taken the guidelines at face value then... With regards to the answer my teacher gave, he said that the answer he gave me was already FDA approved and would say nothing more. I tried asking for the solution but he said he was not provided with it. He did not bother to discuss further with me since he said this problem was only for our practice purposes. Again, thanks for all the replies. I'll be posting my findings again after going through all the information you guys provided. Thanks, Paolo |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2010-07-14 17:17 (5420 d 05:03 ago) @ preyes323 Posting: # 5627 Views: 14,075 |
|
Dear Paolo! ❝ […] my teacher […] did not bother to discuss further with me since he said this problem was only for our practice purposes. (Some) teachers are funny persons, aren't they? If the problem is 2×2 and you get 5 and he claims 3 and there are rumors that there's another result like 4 - don't worry: It's for practice purposes only! Non scholae, sed vitae discimus ❝ Again, thanks for all the replies. I'll be posting my findings again after going through all the information you guys provided. Good luck! On the contrary to your teacher we don't have the right (?!) answer yet. ![]() — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2010-07-15 13:05 (5419 d 09:15 ago) @ preyes323 Posting: # 5633 Views: 14,073 |
|
Dear paolo, if your teachers result was FDA approved it is sainted. No need to dare to ask where it comes from. Follow Helmut's piece of advice and learn this lesson for your further live: If you are asked, whatever question, always answer "It is FDA approved!" ![]() Holy mackerel! (in German, not literally: Heiliger Bimbam!). How ignorant can it yet be? — Regards, Detlew |
preyes323 ☆ 2010-07-16 04:28 (5418 d 17:52 ago) @ d_labes Posting: # 5643 Views: 14,260 |
|
Hi All, ❝ Your implementation of the intra-subject contrast T-R (ilat in the guidance) is faulty. You must calculate T-0.5(R1+R2). My bad on this. I went through my code a number of times but didn't even notice this!!! ![]() ❝ • The SAS code given in the guidance is half-cooked. See here and here. ❝ First: To get a 95% upper CI of the scaled ABE criterion IMHO you must use ❝ alpha=0.05 in the intermediate analysis of ilat. ❝ • Second: The ominous x in the IGLM2 part of the code is IMHO wrong. What ❝ wee need here is (YT-YR)2 and this would translate to me to ❝ in the SAS code. I revised this two as well (see way below for my codes ![]() ❝ I am also confused with the difference between the S2wr results by the ABE SAS code by FDA (page 9 of progesterone guideline) using PROC Mixed and the S2wr formula for intra-subject contrasts. I tried using both as well. I produced the results that was earlier posted. Why is it that Sigma2WR values are different? Is this ok? I read in your other posts the Progesterone guidance makes use of MoM. Is MoM the approach really used for SABE then? Thanks again. Thanks and Regards, Paolo Code for IGLM
proc glm data=SABE.scavbe_Cmax; Code for Crit Bound data SABE.upper_cmax; |
d_labes ★★★ Berlin, Germany, 2010-07-16 12:42 (5418 d 09:39 ago) @ preyes323 Posting: # 5644 Views: 13,950 |
|
"If debugging is the process of removing bugs, then programming must be the process of putting them in." (Edsger W. Dijkstra) Dear Paolo, ❝ »... You must calculate T-0.5(R1+R2). ❝ My bad on this. I went through my code a number of times but didn't even notice this!!! See the subject of these posts and the slogan of he day ![]() Or another one in German "Man sieht den Wald vor lauter Bäumen nicht!" (Rough translation: Don't see the wood for the trees.) ❝ I revised this two as well (see way below for my codes I have calculated using (is theta in your code) theta2 = ((log(1.25)/0.2936)2=(0.76)2 (BTW: Yes nitpickers, of course I know it's really (log(1.25)/sqrt(log(0.3*0.3+1)))^2=(0.7601283...)^2 ![]() This is recommended by Tothfalusi et. al. (see here for literature) to avoid a discontinuity at the switching variance of CV=30% (switch from usual 80 ... 125% acceptance range to the widened ranges) and is the regulatory constant in the new EMA bioequivalence guidance. This discontinuity leads to a high alpha-inflation around CV=30%. ❝ I am also confused with the difference between the S2wr results by the ABE SAS code by FDA (page 9 of progesterone guideline) using PROC Mixed and the S2wr formula for intra-subject contrasts. I tried using both as well. I produced the results that was earlier posted. Why is it that Sigma2WR values are different? Is this ok? Dear Paolo: Sorry but this question is plaguing us as well and is source of our continuing discussion here. Especially we don't know if one can trust in the results of the FDA Proc Mixed code in case of the extra-reference design your data came from. ![]() — Regards, Detlew |
preyes323 ☆ 2010-07-17 13:14 (5417 d 09:06 ago) @ d_labes Posting: # 5648 Views: 13,851 |
|
Hi d_labes, ❝ I have calculated using (is theta in your code) ❝ ❝ (BTW: Yes nitpickers, of course I know it's really ❝ (log(1.25)/sqrt(log(0.3*0.3+1)))^2=(0.7601283...)^2 Yes, I included theta in my code. From what I see our main difference might be in the formula for the crit bound. The formula I used is the one from the FDA progesterone guideline. Did you use the same? data SABE.upper_cmax; ❝ Dear Paolo: Sorry but this question is plaguing us as well and is source of our continuing discussion here. ❝ Especially we don't know if one can trust in the results of the FDA Proc Mixed code in case of the extra-reference design your data came from. I see. ![]() Thanks and Regards, Paolo |
d_labes ★★★ Berlin, Germany, 2010-07-19 12:00 (5415 d 10:20 ago) @ preyes323 Posting: # 5653 Views: 14,169 |
|
Hi Paolo, mine (your theta is mine theta2): ❝ ❝ ❝ — Regards, Detlew |
ElMaestro ★★★ Denmark, 2011-02-06 12:54 (5213 d 08:26 ago) @ preyes323 Posting: # 6564 Views: 13,316 |
|
Hi all, sorry to ask about this: Do any of you have the dataset used in this post in a format that is more readable (ideally, saved from Excel in a txt-file) ?? Thanks a lot for any help. — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2011-02-06 14:02 (5213 d 07:18 ago) @ ElMaestro Posting: # 6565 Views: 13,366 |
|
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |