gcpatel126 ☆ India, 2015-12-09 19:08 (3420 d 18:32 ago) Posting: # 15712 Views: 21,375 |
![]() |
Dear All How to calculate Emax and ED50 (Fitting based on the assumption of nonlinear mixed effect model (population model) or Fitting based on nonlinear least square regression pooling individual observation (naive pooled data method) in WinNonlin. Thanks, Dr. G C Patel Edit: Category changed. [Helmut] |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-10 03:09 (3420 d 10:31 ago) @ gcpatel126 Posting: # 15713 Views: 19,274 |
|
Hi G.C., please RTFM – the “Phoenix NLME 1.3 User’s Guide” in particular. See the two examples pp183–9 (pp191–7 of the PDF). Alternatively you can use one of WNL’s PD models (#101–108): In the Structure-tab Set WNL . Try it with the emax -dataset (Population fitting, default setup):
If you have difficulties with the setup, I suggest to register at Certara’s forum. There you could upload your project-file for examination by people who get paid for that. ![]() — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-10 18:34 (3419 d 19:06 ago) @ Helmut Posting: # 15719 Views: 19,038 |
|
Hi Helmut, Many Thanks for your quick support. I have only one query now. In the example data emax.dat, all AUEC values are positive. However in our data we have both positive and negative. When we run the NLME population models, Should we convert them to all positive or keep as it is? Thanks, Dr. G C Patel |
SDavis ★★ ![]() UK, 2015-12-15 12:50 (3415 d 00:50 ago) @ gcpatel126 Posting: # 15730 Views: 18,770 |
|
Dr. Patel, I suppose it depends a little on what your PD measurement is at the moment, I would say conceptually at least to me, it's easier ot use raw untransformed data, if you have negative values does that mean you are looking at a change from baseline? Simon PS to reiterate Helmut's comment that on the Certara forum you could post your project and we can perhaps advise better then. — Simon Senior Scientific Trainer, Certara™ [link=https://www.youtube.com/watch?v=xX-yCO5Rzag[/link] https://www.certarauniversity.com/dashboard https://support.certara.com/forums/ |
gcpatel126 ☆ India, 2015-12-29 16:49 (3400 d 20:51 ago) @ SDavis Posting: # 15776 Views: 18,271 |
|
Hi Simon, Please find below FDA guideline data for calculation ED50 and Emax using nonlinear mixed effect model (population model). Please let me know value matches with guideline or not. Subject Dose AUEC Thanks, Dr. G C Patel Edit: Reformatted with BBcodes. [Helmut] |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-29 18:46 (3400 d 18:55 ago) @ gcpatel126 Posting: # 15777 Views: 18,431 |
|
Hi G.C., ❝ Please find below FDA guideline data for calculation ED50 and Emax using nonlinear mixed effect model (population model). Please let me know value matches with guideline or not. These data smell of FDA’s 1995 (!) Guidance on topical corticosteroids, Table AIII.4… Software: P-Pharm (Simed, France). ED50 1.89 h, Emax –48.8 h. The software doesn’t exist any more, the developer went out of business, the FDA didn’t give any details (fitting algo, weighting, constraints, …). Do you really expect that anybody without a time-machine will be able to reproduce these numbers? Was the fitted line drawn by someone with shaky hands or did the software spit it out? These nice bars are standard errors – not standard deviations, aka cheating with statistics. At 0.75 hours the mean is –17.7 and the SD 21.4. Agreed, the SE with 6.2 looks better. The CVs range from 60 – 250%. Did you look at the individual data? BTW, addressing Simon here is not a splendid idea. He passes by about once a month in his spare time. I hope for him that he is enjoying a Christmas / New Year vacation. Why didn’t you register at Certara’s forum and upload something there – as Simon and I suggested – instead of posting a data-cemetery full of tabs nobody could copy/paste? Please read Eric Raymond’s essay How To Ask Questions The Smart Way. I’m half tempted to close this thread. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-29 19:04 (3400 d 18:37 ago) @ Helmut Posting: # 15778 Views: 18,869 |
|
Hi Helmut, Already I have registered Certara’s forum and sent same data but value does not matched with FDA guideline. Thanks, Dr. G C Patel |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-29 20:36 (3400 d 17:04 ago) @ gcpatel126 Posting: # 15779 Views: 18,302 |
|
Hi G.C., ❝ Already I have registered Certara’s forum and sent same data but value does not matched with FDA guideline. Please give a definition of “matching” – what did you expect to achieve? The FDA fitted only the means. Don’t know why you want to deal with a Population model. Below a comparison:
Nonlinear mixed-effects modeling… The recipe is a mixture of science, experience, luck, and art. The finished product sometimes is inedible. I think that the FDA’s results are crap. Not only the poor fit, but already the squeezed model. I’m able to come up with similar crap in PHX/NLME as well.
Tortured data will confess to anything. Fredric E. Menger The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data. John W. Tukey — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-30 15:43 (3399 d 21:58 ago) @ Helmut Posting: # 15780 Views: 18,078 |
|
Hi Helmut, Thanks for your detailed response. We also get same value using WinNonlin. Thanks, Dr. G C Patel |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-30 15:56 (3399 d 21:45 ago) @ gcpatel126 Posting: # 15781 Views: 18,017 |
|
Hi G.C., ❝ Thanks for your detailed response. Welcome. ❝ We also get same value using WinNonlin. Are you satisfied now or even more worried? Why didn’t you bother to answer any of my questions? I still think that the model is wrong. If I compare FDA’s results to the others its relative error (bias, if you want) is +22.7% for Emax and +65.8% for ED50. Now what? — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-30 16:19 (3399 d 21:22 ago) @ Helmut Posting: # 15782 Views: 17,911 |
|
Hi Helmut, As we all know, for most of the cases we are validating our methods and software tools based on regulatory's guideline data. The same we are doing for this ED50 calculation. We tried many tools but none of them match exactly or come too closer to guideline data result. You have written that model is wrong, which model are you talking ? Is it mentioned in guideline ? OR any other ? You have compared the results and there is difference also, our question is also the same if values are different compare to guideline than is it acceptable to use that tool ? Finally do you have any preference for software to use for this calculation ? Many thanks, Dr. G C Patel |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-30 17:02 (3399 d 20:38 ago) @ gcpatel126 Posting: # 15783 Views: 18,062 |
|
Hi G.C., ❝ […] for most of the cases we are validating our methods and software tools based on regulatory's guideline data. Not a particularly good idea. What’s written in GLs is not necessarily correct. F.i. the CVintra in Canada’s BE guidance example data set was wrong for decades. Not only the value, but also the formula. See this presentation about validation of software. ❝ The same we are doing for this ED50 calculation. We tried many tools but none of them match exactly or come too closer to guideline data result. ❝ ❝ You have written that model is wrong, which model are you talking ? Is it mentioned in guideline ? OR any other ? Since the FDA reported only Emax and ED50 on p.29 I used the simple model $$E=(E_\text{max}\times D)/(E_{50}+D)\tag{1}$$ The GL mentions on p.4 also the baseline model $$E=E_0+(E_\text{max}\times D)/(E_{50}+D)\tag{2}$$ Let’s compare them (fitting mean data)
❝ You have compared the results and there is difference also, our question is also the same if values are different compare to guideline than is it acceptable to use that tool ? Which tool? I cannot imagine that you will be able to find any software which comes even close to the FDA’s results. Not by any chance the software vendor went out of business. In the same guidance the FDA asked for data submitted on a diskette without specifying details. 8", 5¼", 3½"? If you want to be fully compliant, visit the next waste disposal site and search for a floppy drive. You could also ask the FDA for a copy of the famous P-Pharm software. ❝ Finally do you have any preference for software to use for this calculation ? Phoenix/NLME. In R: nls/nlme/lme4, though it is not that easy to guess suitable starting values and specify weighting schemes. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-30 18:47 (3399 d 18:53 ago) @ Helmut Posting: # 15784 Views: 17,869 |
|
Hi Helmut, Thanks for clarification on guideline's example correction and the link provided by you is really useful. You have compared two methods and based on AIC value you have concluded the result. Which software you have used to calculate these two cases ? My meaning for tool is that.. if my tool's result value is different then FDA's tool's result values then will it be acceptable for them ? I know that P-Pharm software is no longer available and I also do not want to use the software which do not have any support existence. Thanks again for investing your valuable time in this discussion. - Dr. G C Patel |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2015-12-30 22:15 (3399 d 15:26 ago) @ gcpatel126 Posting: # 15787 Views: 18,106 |
|
Hi G. C., ❝ You have compared two methods and based on AIC value you have concluded the result. Which software you have used to calculate these two cases ? Phoenix NLME 1.3. The AIC is available in all software I know (except Excel, of course). ❝ My meaning for tool is that.. if my tool's result value is different then FDA's tool's result values then will it be acceptable for them ? Heck, do you really believe the FDA insists in reproducing a result from obsolete software which is 20+ years old? It’s somehow difficult to speak about “correct” or “false”. But what do we have: One result obtained by the (in)famous P-Pharm and others which are almost identical across five other software packages and six fitting algos – but different to what’s given in the guidance. There is no democracy in science but the odds are >5:1 against the FDA. I’m pretty sure you would get similar results in other software as well (hey guys: SAS, S+, Kinetica, NCSS, SPSS, MatLab, STaTa, STATISTICA, OO Calc, …) Maybe back in ’94/95 the FDA was hit by the Pentium bug? The time window would fit just perfectly! We could set up an experimentum crucis. Generate data from known parameters and compare results. In my example the data are exact, i.e., without error. Do you agree that we should expect almost identical results? Emax = –50, ED50 = 1.
nls by design does not allow fitting error-free data. I added ε [0, 10–6].
\(\small{-25=a/(1+b)}\) \(\small{-40=4a/(4+b)}\) Simsalabim: \(\small{a=-50,\,b=1}\) At least the comparison should give you strong confidence that these software packages perform well and what the FDA reported is poo. See also this post. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
gcpatel126 ☆ India, 2015-12-31 08:06 (3399 d 05:34 ago) @ Helmut Posting: # 15788 Views: 17,854 |
|
Hi Helmut, Thanks for conforming the software you have used. I know FDA will not insist to produce that result and I focused only that to determine the right method with right tool. This conversation will helps a lot in my process. I have also verified the values using various tools and its same. Thanks for your immediate responses. - Dr. G C Patel |
gcpatel126 ☆ India, 2016-01-11 15:54 (3387 d 21:46 ago) @ gcpatel126 Posting: # 15813 Views: 16,831 |
|
Hi Helmut, Revisitng again this discussion, I want your suggestion on one scenario. For one dose duration response study we have calculated ED50 and Emax by population model using Phoenix® NLME™ and we got below results. ED50 : 120 Emax : -35 On other hand, using PPHARM software the values are as below, ED50 : 50 Emax : -26 As you can see the difference is very big. Now what you suggest, Should we go with Phoenix® NLME™ or PPHARM values ? If we submit Phoenix NLME results to FDA, will be there any query from FDA as they are using PPHARM software ? Please let us know your views. Many thanks, Dr. G C Patel |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2016-01-11 23:13 (3387 d 14:28 ago) @ gcpatel126 Posting: # 15815 Views: 16,911 |
|
Hi G.C., ❝ For one dose duration response study we have calculated ED50 and Emax by population model using Phoenix® NLME™ and we got below results. ❝ ED50 : 120 ❝ Emax : -35 ❝ On other hand, using PPHARM software the values are as below, ❝ ED50 : 50 ❝ Emax : -26 You are responsible for validating your software in your computing environment, not I. I don’t know P-Pharm. Since it disagrees with PHX/NLME already at the first (!) significant digit, I guess it’s crap. Have a look at the NIST’s reference datasets. The certified results were obtained in 128bit precision. The NIST considers an estimate obtained by other software acceptable if >4 significant digits match the certified result. I can only say, that my installation (Phoenix 6.4.0.768 / NLME 1.3 64bit) on my machine (Xeon E3-1245v3 Haswell 4×3.4GHz / 16GB RAM) with my OS (64bit Win7 SP1 all patches) gives for most datasets matches of 5–7 significant digits already with the first set of start values (sometimes even better with the second). Do your homework. This conversation leads to nowhere. EOD from my side. Thread closed. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |