Helmut ★★★ Vienna, Austria, 2019-07-21 17:20 (1912 d 18:18 ago) Posting: # 20417 Views: 5,148 |
|
Dear all (and esp. Shuanghe), I don’t want to hi-jack ElMaestro’s thread about spreadsheets any longer. Shuanghe and I had an OT-discussion about indirect adjusted comparisons in BE starting here. I must confess that I don’t get what Luther Gwaza et al.1,2 means by his “pragmatic method”: This method does not require the assumption of homogeneity of variances (\(SE_d=SE_{A}^{2}+SE_{B}^{2}\)), since it is unlikely verifiable, between studies with small sample sizes that follow Student’s t-test distribution (t0.9,d.f.), whose degrees of freedom are approximated for simplicity as if the variances were homogeneous (n1+n2–2). Sounds great but how does he pool variances here? If they are weighted by the studies’ sample sizes – which IMHO, is the correct method – we end up in the homoscedastic method, where (in his notation):$$SD_{pooled}^{2}=\frac{(n_1-1)SD_{1}^{2}+(n_2-1)SD_{2}^{2}}{n_1+n_2-2}$$ BTW, is this a typo in the quote? A pooled variance as the sum? I suspect that he simply used the arithmetic mean which would not be correct even for equal samples & variances. @Shuanghe: How did you do it?
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
mittyri ★★ Russia, 2019-07-22 03:46 (1912 d 07:52 ago) @ Helmut Posting: # 20419 Views: 4,415 |
|
Dear Helmut, ❝ I must confess that I don’t get what Luther Gwaza et al.1,2 means by his “pragmatic method”: agree, intricated explanation In the discussion part I've found The method based on a combination of both (SE calculation of the heteroscedastic method and degrees of freedom of the homoscedastic method), which is the simplest numerical calculation, gives results similar to those obtained with the heteroscedastic approach, showing that the contribution of the different method of calculation of the degrees of freedom is negligible. Heteroscedatic method + simplified DFsI also found some paper where the authors are using that approach, but I don't think their understanding of 'pragmatic' is correct — Kind regards, Mittyri |
Shuanghe ★★ Spain, 2019-07-22 11:53 (1911 d 23:45 ago) @ Helmut Posting: # 20421 Views: 4,433 |
|
Dear Helmut, ❝ I must confess that I don’t get what Luther Gwaza et al.1,2 means by his “pragmatic method”: I must confess that I didn't understand it either (I even checked the dictionary to see if I misunderstood the word somehow ). I suppose that it's just a name invented by Gwaza as I didn't see any reference citing the source of the name. ❝ @Shuanghe: How did you do it? The variance is simply obtained by \(SE_d^2 = SE_1^2 + SE_2^2\) and the degree of freedom used for confidence interval is \(n_1 + n_2 - 2\). I have to admit it that it puzzled me as well so I found all articles that I can found from the same group to see if others might gave better description of the method. So in addition to Gwaza's articles, I have Herranz 2013, Pejčić 2019 etc, but it seems that the excel template is not the only thing Gzawa gave to others---the description of the method are all very similarly cryptic. OT again: Thanks a lot for implementing MathJax. Equations are looking much better. one puzzle though: command \LaTeX does do what it supposed to do. — All the best, Shuanghe |
nobody nothing 2019-07-22 15:32 (1911 d 20:06 ago) @ Shuanghe Posting: # 20423 Views: 4,367 |
|
"Pragmatic" is normally the term you use if there is no sound theoretical and/or scientific justification for the shortcut you take... Is there really nothing more in the "Methodology" of the full publication than what mittyri found in the discussion? Wow, who reviewed this publication/thesis? 8-) — Kindest regards, nobody |
Shuanghe ★★ Spain, 2019-07-22 17:20 (1911 d 18:17 ago) @ nobody Posting: # 20424 Views: 4,328 |
|
Dear nobody, ❝ Is there really nothing more in the "Methodology" of the full publication than what mittyri found in the discussion? Wow, who reviewed this publication/thesis? 8-) Nope. Not that I can find, e.g., in Pejčić's article*, the description is word for word copy of what Helmut quoted above so i don't want to copy/paste it again. Pejčić, Zorica; Vučićević, Katarina; García-Arieta, Alfredo and Miljković, Branislava. Adjusted indirect comparisons to assess bioequivalence between generic clopidogrel products in Serbia. Br. J. Clin. Pharmacol., 2019. DOI:10.1111/bcp.13997 — All the best, Shuanghe |
Helmut ★★★ Vienna, Austria, 2019-07-22 17:45 (1911 d 17:53 ago) @ Shuanghe Posting: # 20425 Views: 4,357 |
|
Hi Shuanghe, Mittyri, and nobody, yep, you are all right. Nobody’s definition of “pragmatic” is correct. IMHO, here it should be called – following Wolfgang Pauli’s footprints – “not even wrong”. Pooling variances without weighting by the sample size is just false. Quoting Shuanghe’s reference, Section Data analysis: In line with recommendations by Gwaza et al., a pragmatic method based on t test was used […]. This method has been shown to give comparable results as the homoscedastic method. Great. What Gwaza et al.* really wrote/recommended is this:The [pragmatic] method based on a combination of both (SE calculation of the heteroscedastic method and degrees of freedom of the homocedastic method), which is the simplest numerical calculation, gives results similar to those obtained with the heteroscedastic approach, showing that the contribution of the different method of calculation of the degrees of freedom is negligible. Gwaza drives me nuts. What is “SE calculation of the heteroscedastic method”? There is only one correct way to pool variances. No, it’s not \(SE_d^2 = SE_1^2 + SE_2^2\). The homo- and heteroscedastic methods differ only in the degrees of freedom.
Comes handy cause most people don’t read beyond the abstract (men on a mission?). When I rank the width of the CIs given in the two tables:
If I use the crappy formula I end up with CIs which are not slightly tighter than the ones of the heteroscedastic method – as expected – but slightly wider. Puzzle not solved. Since I’m dealing with HVD(P)s, where the CV jumps around like crazy between studies I prefer the heteroscedastic approach. ❝ OT again: Easy. ❝ Thanks a lot for implementing MathJax. Equations are looking much better. one puzzle though: command \LaTeX does do what it supposed to do. There is not \LaTex in MathJax. See there for examples (including a link to the MathJax site).
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! Helmut Schütz The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2019-07-22 20:38 (1911 d 14:59 ago) @ Helmut Posting: # 20427 Views: 4,299 |
|
Dr. Gwaza is apparently affiliated to the WHO nowadays from what I found by a quick search. Maybe someone should contact him for details on the background of the pragmatic approach employed... I find that somewhat disturbing to publish a "new" method without any substantial scientific background described and others start using this "published method" for the next few centuries. I see that quite often in recent times in various fields. — Kindest regards, nobody |