Groups: Overlapping CIs [Design Issues]
thank you for the illustration with specific example.
❝ Model I (pooled data)
❝ p(G×T) = 0.024984
❝ Model II (pooled data)
❝ PE = 97.64%
❝ 90% CI = 85.53 – 111.47%
❝ CVw = 27.13%
❝ Model III (group 1)
❝ PE = 82.54%
❝ 90% CI = 68.23 – 99.86%
❝ CVw = 26.16%
❝ Model III (group 2)
❝ PE = 115.50%
❝ 90% CI = 98.04 – 136.08%
❝ CVw = 22.43%
❝ As to be expected, the Group-by-Treatment interaction is significant.
❝ The study passes with flying colors by Model II. Also expected because the study was powered for \(\small{\mu_2=1/\mu_1=1}\).
❝ Both groups assessed by Model III fail. Of course, they do because we simulated them at the limits of the BE range. However, their confidence intervals do overlap.
Like you said in the other post ("Even if an assessor would calculate the confidence interval of groups separately, likely they would overlap due to the limited sample sizes."), they most likely overlap because of the relatively small sample size (n=12 per group). Probably if we had larger total sample size (in this example it would maybe be reasonable as CVw is around 27%, e.g. total sample size of 32 or 36 subjects) and thus larger sample size per group then groups' 90% CI most likely wouldnt overlap.
I am just wondering if variabilty is moderate and the sample size is large enough (--> high power) then in most cases groups' 90% CI probably wouldnt overlap in case of significant G*T interaction?
BEQool
Complete thread:
- Possible reasons for group effect GM 2019-07-20 07:36 [Design Issues]
- Group “effect” Helmut 2019-07-20 14:02
- Possible reasons for group effect ElMaestro 2019-07-20 19:20
- Possible reasons for group effect GM 2019-07-23 06:23
- “Group-by-Treatment Interaction” Helmut 2019-07-23 10:32
- “Group-by-Treatment Interaction” BEQool 2024-10-22 12:39
- “Group-by-Treatment Interaction” Helmut 2024-10-22 12:47
- OT: A choice between mittyri 2024-10-22 16:03
- OT: A choice between BEQool 2024-10-23 11:02
- OT: A choice between Helmut 2024-10-23 11:58
- OT: A choice between BEQool 2024-10-23 13:17
- OT: A choice between Helmut 2024-10-23 13:22
- Groups: Overlapping CIs Helmut 2024-11-03 11:36
- Groups: Overlapping CIsBEQool 2024-11-05 09:14
- Groups: Overlapping CIs Helmut 2024-11-05 10:12
- Groups: Overlapping CIs BEQool 2024-11-06 07:44
- Groups: (Hardly‽) overlapping CIs Helmut 2024-11-21 13:20
- Groups: (Hardly‽) overlapping CIs BEQool 2024-11-22 12:32
- Groups: (Hardly‽) overlapping CIs Helmut 2024-11-22 12:58
- Multiplicity? Helmut 2024-11-23 13:05
- Groups BEQool 2024-11-26 08:15
- Groups: (Hardly‽) overlapping CIs BEQool 2024-11-22 12:32
- Groups: (Hardly‽) overlapping CIs Helmut 2024-11-21 13:20
- Groups: Overlapping CIs BEQool 2024-11-06 07:44
- Groups: Overlapping CIs Helmut 2024-11-05 10:12
- Groups: Overlapping CIsBEQool 2024-11-05 09:14
- OT: A choice between BEQool 2024-10-23 13:17
- OT: A choice between Helmut 2024-10-23 11:58
- OT: A choice between BEQool 2024-10-23 11:02
- OT: A choice between mittyri 2024-10-22 16:03
- “Group-by-Treatment Interaction” Helmut 2024-10-22 12:47
- “Group-by-Treatment Interaction” BEQool 2024-10-22 12:39
- “Group-by-Treatment Interaction” Helmut 2019-07-23 10:32
- Possible reasons for group effect GM 2019-07-23 06:23