Model selection [Software]

posted by Helmut Homepage – Vienna, Austria, 2009-01-29 14:54 (6344 d 04:14 ago) – Posting: # 3162
Views: 6,425

Dear Pavan!

❝ In another data set the R2 values of both linear and quadratic

❝ are equal (ie 0.9954) in this situation,


❝ How we can identify the best fit?


R2 (coefficient of determination) and R (coefficient of correlation) are ineffectual decision tools. To identify the best model first prepare a residual plot (x: calculated value, y: residual = calculated - measured):See one of my presentations (slides 29-32). In the linear fit (w=1/x) we get a curve of residuals → going to quadratic, residuals are spread around zero – but there's still massive hetero­sce­das­ticity → final model: quadratic, w=1/x2.

❝ Is there any statistical test to decide which one is the best fit in all

❝ best fits of the linear and quadratic.


In my example you see that correlation is unsuitable; 0.9995 (w=1/x) seems to be better than 0.9994 (w=1/x2). Decision should be based on residuals and back-calculated x-values. The better model may be chosen based on the minimum AIC (Akaike's Information Criterion) which comes up with 149.5 for w=1/x and with 109.9 for w=1/x2. Another possibility would be an F-test.

Remember: According to FDA's guideline you have to justify the chosen model during validation. You may remove calibration points (during validation as well as in the study) only as long as the model will not change.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Complete thread:

UA Flag
Activity
 Admin contact
23,653 posts in 4,991 threads, 1,570 registered users;
96 visitors (0 registered, 96 guests [including 33 identified bots]).
Forum time: 20:09 CEST (Europe/Vienna)

To propose that poor design can be corrected by subtle analysis techniques
is contrary to good scientific thinking.    Stuart J. Pocock

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5