no way out for NCA validation? [NCA / SHAM]
Hi Helmut,
from your lecture:
‘Black box’ validation
Create ‘worst-case’ datasets (extreme range of input, enter floating point numbers to integer fields, enter characters to numeric fields…).
So what is the problem to validate WNL NCA using the datasets (OK, not only from literature since there are so many troubles as you showed, but some simulated)?
All rules are written in the User's guide, so it could be crosschecked against handmade R code. Or should it be validated against another validated software (which does not exist)?
from your lecture:
‘Black box’ validation
- Run datasets with certified results (e.g., from NIST’s Statistical Reference Datasets Project).
– FDA (2002)
- Testing with usual inputs is necessary.
- However, testing a software product only with expected, valid inputs does not thoroughly test that software product.
- By itself, normal case testing cannot provide sufficient confidence in the dependability of the software product.
So what is the problem to validate WNL NCA using the datasets (OK, not only from literature since there are so many troubles as you showed, but some simulated)?
All rules are written in the User's guide, so it could be crosschecked against handmade R code. Or should it be validated against another validated software (which does not exist)?
—
Kind regards,
Mittyri
Kind regards,
Mittyri
Complete thread:
- AUC0-tau at steady state BNR 2016-03-31 22:46 [NCA / SHAM]
- AUC0-tau at steady state jag009 2016-03-31 23:05
- AUC0-tau at steady state BNR 2016-03-31 23:43
- RTFM Helmut 2016-04-01 00:59
- RTFM BNR 2016-04-01 02:05
- AUC0-τ estimation with time deviations Astea 2019-02-10 16:38
- AUC0-τ estimation with time deviations Helmut 2019-02-10 19:32
- Cτ for lin and lin-up/log-down Astea 2019-02-10 20:50
- Cτ by lin-/lin, lin-up/log-down, and λz Helmut 2019-02-11 01:45
- inter- vs extra- Astea 2019-02-11 19:46
- inter- vs extra- Helmut 2019-02-12 02:20
- No rule fits all mittyri 2019-02-14 12:55
- one size fits all vs goal posts Astea 2019-02-16 08:33
- one size fits all vs goal posts ElMaestro 2019-02-16 13:33
- Bias etc. Helmut 2019-02-16 14:26
- software: NCA not validated Helmut 2019-02-16 13:59
- no way out for NCA validation?mittyri 2019-02-20 21:22
- Default rules mittyri 2019-02-20 21:40
- one size fits all vs goal posts ElMaestro 2019-02-16 13:33
- one size fits all vs goal posts Astea 2019-02-16 08:33
- inter- vs extra- Astea 2019-02-11 19:46
- Cτ by lin-/lin, lin-up/log-down, and λz Helmut 2019-02-11 01:45
- Cτ for lin and lin-up/log-down Astea 2019-02-10 20:50
- AUC0-τ estimation with time deviations Helmut 2019-02-10 19:32
- RTFM Helmut 2016-04-01 00:59
- AUC0-tau at steady state BNR 2016-03-31 23:43
- AUC0-tau at steady state jag009 2016-03-31 23:05