Denmark Curiosa (1 in 90% CI in 0.8-1.25) [Power / Sample Size]
thanks for comments (especially for the second).
❝ One minor comment to your code:
❝ The number of sims you used (1e4
as far as I could see) is a little bit low. Especially if you come into regions with power <=0.05.
You are right. I did the code faster for testing and unfortunately I forgot to change it to the higher number before producing figures. Nevertheless it was enough for the purpose of the post (combined with not much important subject of the post). Additionally all <=0.05 values were black in the levelplots, and I was much more interested in the power about 80 or close to 90%.
❝ Another comment to the Danish requirement:
❝ ... that another construction of the CI may be used, namely
CI+ = (low, 1) if high is < 1
CI+ = (1, high) if low is >1
CI+ = (low, high) if low is <=1 and high is >=1
❝ where low
and high
are the conventional confidence interval limits.
- we get 95% confidence interval instead of only 90% (more accurately when true GMR=1 we get 100% CI, otherwise we get 95% CI - due to the modified construction of CIs and according to the results from Aaron Zeng R code for TOST CI simulation),
- we get always value 100% in 95% CI,
- eventually "bad" observed GMR is hidden somewhere in the 95% CI (assymetrical CI even in ln-transformed data when extended to zero), e.g. from standard 90% CI 82-86% we create little bit better looking CI 82-100% (from such CI no one knows where the observed GMR was),
- no one can calculate intra-subject variability from such CI (when lower or upper CI limit is equal to 100%) - although, it would be possible to calculate it from non-100% CI limit and observed GMR.
❝ This observation makes the Danish requirement statistical nonsense.
The property of extending CI to include 100% without adjusting the alpha is interesting. I had to remind myself what the confidence interval means. I always slide in mind to probability which is common misunderstanding - citation:
"A 95% confidence interval does not mean that for a given realised interval calculated from sample data there is a 95% probability the population parameter lies within the interval. Once an experiment is done and an interval calculated, this interval either covers the parameter value or it does not; it is no longer a matter of probability. The 95% probability relates to the reliability of the estimation procedure, not to a specific calculated interval."
If it was probability (but it is not), the change of 90% CI would be to the something between 90-95% CI. For example 90% CI 87-98%, then there would be probability 5% that true GMR value is outside of the 90% CI lower and 5% outside higher. When no change of lower limit of 90% CI and adding some values up to value 100% to create a new CI, there would still be 5% probability to have true GMR lower and several percent probability to have true GMR higher than 100%. - Text in red is wrong (it's how the CI may be wrongly understood).1) When we are constructing classical 90% CI (alpha=0.05) - the 90% of hypothetically observed confidence intervals contains the true GMR.
2) When we are constructing alternative 95% CI (alpha=0.05) - the 95% of hypothetically observed alternative confidence intervals contains the true GMR,
where alternative 95% CI is classical 90% CI extended to 100% value.
So when we use the second CI construction according to the references mentioned by d_labes (as standard 90% CI extended to have 100% in), we get 95% CI (with assumption that true GMR is not equal to 100% - it's not limiting us, in that case we get the best CI (i.e. 100% CI)).
❝ See also here.
I tried simulations (with patience) (and with reading the steps to find out what was done there), nevertheless I failed to get reported results (with seed after the # symbol).
mean(coverge.ci90) # ci90 is the classical 90% CI for difference T-R
#[1] 0.90086
mean(coverge.ci95) # ci95 is the classical 90% CI extended at one side to zero (CI is for difference T-R)
#[1] 1 # For T100=R100 it is obviously always equal to 1. Wow 100% CI! Great! Because true difference T-R is a fixed value (zero), all simulated (hypothetically observed) confidence intervals will hold the true difference.
# Otherwise (i.e. T100 differs from R100) it's about 0.95 ... due to simulations I used the word "about" but it's 0.95. (My shame I was expecting something between 0.9-0.95 until reminding myself the definitions.)
Complete thread:
- Denmark Curiosa (1 in 90% CI in 0.8-1.25) zizou 2017-02-05 02:03 [Power / Sample Size]
- Kudos! Helmut 2017-02-05 19:16
- Kudos! ElMaestro 2017-02-05 21:15
- Joking! Helmut 2017-02-06 13:27
- Thanks, and DKMA ElMaestro 2017-02-06 13:46
- Power with a Danish twist Helmut 2017-02-07 15:23
- Danish ultra-conservatism d_labes 2017-02-08 10:57
- Danish ultra-conservatism Helmut 2017-02-08 11:47
- Danish ultra-conservatism d_labes 2017-02-08 10:57
- Power with a Danish twist Helmut 2017-02-07 15:23
- Thanks, and DKMA ElMaestro 2017-02-06 13:46
- Kudos to ElMaestro! d_labes 2017-02-06 15:06
- Plausible Helmut 2017-02-06 17:16
- Plausible to me too d_labes 2017-02-06 20:25
- Plausible to me too ElMaestro 2017-02-06 22:30
- Plausible to me too zizou 2017-02-06 22:42
- THX d_labes 2017-02-07 10:01
- Plausible to me too d_labes 2017-02-06 20:25
- Plausible Helmut 2017-02-06 17:16
- Joking! Helmut 2017-02-06 13:27
- Kudos! ElMaestro 2017-02-05 21:15
- 3D Helmut 2017-02-06 13:47
- Denmark Curiosa (1 in 90% CI in 0.8-1.25) d_labes 2017-02-06 14:54
- Denmark Curiosa (1 in 90% CI in 0.8-1.25)zizou 2017-02-08 21:03
- Alternative CI for BE decision d_labes 2017-02-09 11:18
- Alternative CI for BE decision ElMaestro 2017-02-09 11:36
- Alternative CI for BE decision d_labes 2017-02-09 11:48
- How decidedly odd ElMaestro 2017-02-09 13:28
- How decidedly odd zizou 2017-02-09 14:42
- How decidedly odd ElMaestro 2017-02-09 13:28
- Alternative CI for BE decision Helmut 2017-02-09 13:41
- No alternative d_labes 2017-02-09 20:37
- No alternative ElMaestro 2017-02-10 13:51
- No alternative? mittyri 2017-02-10 15:28
- Dinamarka? d_labes 2017-02-10 20:10
- OT: Czech beer d_labes 2017-02-10 19:57
- No alternative? mittyri 2017-02-10 15:28
- No alternative ElMaestro 2017-02-10 13:51
- No alternative d_labes 2017-02-09 20:37
- Alternative CI for BE decision d_labes 2017-02-09 11:48
- Alternative CI for BE decision ElMaestro 2017-02-09 11:36
- Alternative CI for BE decision d_labes 2017-02-09 11:18
- Denmark Curiosa (1 in 90% CI in 0.8-1.25)zizou 2017-02-08 21:03
- Denmark Curiosa (1 in 90% CI in 0.8-1.25): Gone Helmut 2019-11-08 12:47
- Kudos! Helmut 2017-02-05 19:16