Elena777 ☆ Belarus, 2018-01-21 09:53 (2259 d 05:43 ago) Posting: # 18238 Views: 14,719 |
|
Dear all! I am new to R and RStudio. It will be very useful to me if you help me with the following questions: 1. Here is an example of my data: CVs <- (" The result I got: CVpooled(CVsCmax, alpha=0.2, logscale=TRUE) Why are degrees of freedom so huge? And why did I get two different results 0.1677 and 0.1750? Is it acceptable and can I use any result to calculate sample size in PowerTOST? What result must I choose (0.1677, 0.1750, 0.1853) for calculating sample size? 2. And the second question. Is argument "digits" from function CVpooled simply a number of observations for a variable? Thank you in advance! |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-21 18:21 (2258 d 21:14 ago) @ Elena777 Posting: # 18239 Views: 13,728 |
|
Hi Elena, please RTFM: After attaching the package either in the R-console or in R-Studio type help(CVpooled) or ?CVpooled . Alternatively read the man-page online.❝ Calculates the CV (pooled from your six studies – assuming that individual CVs were obtained from log-transformed data). Furthermore, CVs are weighed by the studies’ degrees of freedom. The dfs depend on how the studies were evaluated; here the default robust=FALSE is applied (more about that later). Hence, we get:0.1677 with 181 degrees of freedom In order to get the 1–α upper confidence limit of the pooled CV, you would have to use the print method and the additional argument verbose=TRUE :print(CVpooled(CVsCmax, alpha=0.2), verbose=TRUE) Pooled CV = 0.1677 with 181 degrees of freedom ❝ ❝ Pooled CV = 0.175054 with 129 degrees of freedom (robust df's) ❝ Upper 80% confidence limit of CV = 0.185309 ❝ ❝ Why are degrees of freedom so huge? You are pooling from six studies which gives you a lot of information. In each of them the degrees of freedom are n–2 for the 2×2 studies and 2n–4 for the 3×3 studies. Type known.designs() to get an idea. We can hack the code of the function to look behind the curtains:CVs.1 <- CVs.2 <- CVsCmax # new data frames Check the dfs which are used to calculate the confidence limit based on the χ2 distribution): cat("Sum of dfs (fixed effects model):", sum(CVs.1$df), The hard way: Calculate pooled weighted variances and back-transform to pooled CVs: cat("Pooled CVs:", For the background of the calculation see this presentation (slides 32–35). ❝ And why did I get two different results 0.1677 and 0.1750? In your second call ❝ print(CVpooled(CVsCmax, alpha=0.2, robust=TRUE), digits=6, verbose=TRUE) you used the argument robust=TRUE (where in the first one implicitly the default robust=FALSE is used). When the CVs in the studies were calculated by ANOVA (or by SAS’ Proc GLM ) the dfs given in column df of known.designs() are used. Only if the CVs were calculated by a mixed effects model (for the FDA e.g., by SAS Proc Mixed ) values of column df2 are used. Note that for 2×2 designs the dfs are identical but for higher-order crossovers the dfs are different (e.g., in your 3×3 the robust dfs are n–3). Since in the latter case the dfs are lower (129 vs. 181), less weight is given to the 3×3 studies with comparably low CVs (pooled CV 0.1751 vs. 0.1677), and the confidence interval is wider (upper CL 0.1853 vs. 0.1758).❝ Is it acceptable and can I use any result to calculate sample size in PowerTOST? No (see below). ❝ What result must I choose (0.1677, 0.1750, 0.1853) for calculating sample size? The pooled ones (0.1677 or 0.1751) assume that it is “carved in stone” (i.e., is the “true” value). I don’t recommend that (if the actual CV will be larger than assumed the study it will be underpowered). If it will be smaller you might have lost money but gained power and the chance to demonstrate BE increases. Which alpha you use, is up to you. 0.2 is my suggestion (and the function’s default).1,2,3,4 Explore increasing levels of alpha :alpha <- c(0.05, 0.2, 0.25, 0.5) You have to know beforehand how the studies were evaluated in order to use the correct setting for the argument robust to get the correct pooled CV and its CL (0.1677 → 0.1758 for studies evaluated by ANOVA and 0.1751 → 0.1853 for ones evaluated by a mixed effects model).❝ Is argument "digits" from function CVpooled simply a number of observations for a variable? No. You get the total number of subjects by … cat("Sum of n (N):", sum(CVsCmax$n), "\n") … and the total number of observations from one of the new data frames by: cat("Sum of observations:", sum(CVs.1$obs), "\n") orcat("Sum of observations:", sum(CVs.2$obs), "\n") Sum of observations: 340 The argument digits tells the print argument which precision to use in the output, where 4 digits is the default:print(CVpooled(CVsCmax), verbose=TRUE) Note that it is a little bit tricky to combine studies evaluated by fixed and mixed effect models. In such a case you have to provide the dfs yourself. Let’s assume that study 4 was evaluated by a fixed effects model (df = 2n–4) and study 4a by a mixed effects model (df = n–3). Provide the dfs in the additional column df (which takes precedence over the combination n and design and the argument robust is not observed any more). I recommend to give an additional column model (which is not used but for clarity):CVs <- (" Repeating it the hard way for comparison: alpha <- 0.2 Hope that helps.
— Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
Elena777 ☆ Belarus, 2018-01-27 11:11 (2253 d 04:25 ago) @ Helmut Posting: # 18296 Views: 13,232 |
|
Helmut, I can`t thank you enough for this super-detailed answer! I`ve got it! |
ElMaestro ★★★ Denmark, 2018-01-27 23:28 (2252 d 16:08 ago) @ Elena777 Posting: # 18297 Views: 13,324 |
|
Hi all, can we take one step back and ask which question the pooled CV provides an answer to? "If the CV across all studies happens to be the same, then which CV is most likely representing all the studies?" [yes, add alfalfa and limits if you wish] Now, I hate to say it, but boring things like blood sampling regimen, analytical setups, stats model, within-batch variation of both T and R, volunteer constraints postdose, and other factors will influence directly on a CV. If you are in doubt, look at the list provided in this thread. Please give me a good reason to believe all those factors (plus all the ones I forgot) are the same across just any two studies. You pick and show me. Until then I consider pooled CV's a curiosity as useful as headmounted toilet paper etc. A cheeseburger is pretty well assumed to be the same regardless of whether you buy it at McDonald's in Pasadena, Paris or Peking. A cheeseburger is a cheeseburger is a cheeseburger. Until we bring Burger King into the picture. Or Hardee's. Or... This pooled business is not the way forward, gentlemen and gentlewomen. But it is highly theoretically and academically appealing, I grant you all that. Now if you will excuse me I must end this post here as I have to blow my nose. I am sure I put that roll of toilet paper somewhere, but I just can't seem to find it right now... Bloody hell... — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-28 01:27 (2252 d 14:09 ago) @ ElMaestro Posting: # 18298 Views: 13,251 |
|
Hi ElMaestro, excellent post, especially re. burgers and toilet paper (another ![]() ![]() When it comes to pooling of CVs you are absolutely right – and got it terribly wrong. Do you remember what you wrote a while ago? In an earlier post I wrote: ❝ Doing the math is just the first step. Before you pool CVs I would suggest to inspect whether the confidence intervals of the CVs overlap […]. If not, try to find out why (different CROs, populations, bioanalytical methods, …). Use common sense to decide which CVs are reliable enough to pool. That’s what statistics is all about – numbers. But never forget the data generating process. Are results obtained by a method of a reputable CRO whose head wrote dozens of papers about trace-MS better than colorimetry done in a back yard lab in Timbuktu? Etc. etc. I suppose it is tempting, if the only tool you have is a hammer, — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
ElMaestro ★★★ Denmark, 2018-01-28 09:43 (2252 d 05:52 ago) @ Helmut Posting: # 18299 Views: 13,173 |
|
Hi Hötzi, ❝ When it comes to pooling of CVs you are absolutely right – and got it terribly wrong. ❝ ❝ Do you remember what you wrote a while ago? I go it terribly right. ![]() I don't remember every post I have written. Or more correctly and defintely more honestly, I don't remember any post I have written. ![]() Contrasting my post with the one you linked to makes it very clear that I am an example of 'radicalisation' as news agencies would call it. ![]() — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-28 12:38 (2252 d 02:57 ago) @ ElMaestro Posting: # 18300 Views: 13,238 |
|
Hi ElMaestro, ❝ I don't remember every post I have written. So do I. The search function helps. ❝ Or more correctly and defintely more honestly, I don't remember any post I have written. That’s the good thing with Alzheimer’s. Every day new acquaintances. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2018-01-28 14:52 (2252 d 00:43 ago) @ ElMaestro Posting: # 18301 Views: 13,182 |
|
Dear Öberster Größter Meister! ❝ Please give me a good reason to believe all those factors (plus all the ones I forgot) are the same across just any two studies. You pick and show me. Until then I consider pooled CV's a curiosity as useful as headmounted toilet paper etc. Please hav a look at Guersey McPearson's prose, Essay "A dip in the Pool": Quote: "It seems to me that people who object to pooling different studies but would quite happily accept any one of them on its own, if only it were large enough, for the purpose of informing medical decision making, should be given thinking lessons." More in the whole essay. — Regards, Detlew |
ElMaestro ★★★ Denmark, 2018-01-29 01:07 (2251 d 14:29 ago) @ Elena777 Posting: # 18302 Views: 13,057 |
|
Hi all, I will take it in good spirit that for some it can be difficult to accept diverging opinions without lashing out in a personal fashion. My ambition with my everyday dialogue is to keep the conversation on the healthy side of the fine line that separates humor from venomous hints. Heteroscedasticity, or non-homogenous variance, is a concrete and widespread matter that is an everyday concern at most pharmaceutical companies and CROs involved in multicenter trials. There are some compelling reasons for taking it seriously including scientific, ethical and pecuniary ones. The companies go to great lengths to control it as much as possible, including using the same equipment, having it calibrated at the same centralised metrology departments, use of same SOPs, and not least having all centres adhere to the same protocol. And much more. It is through such effort that companies can justify using a stats model that assume variance homogeneity implicitly. The alternative would be pretty nasty and untenable. There is no particular scientific reason to assume variance homogeneity for studies done at different times, at different locations, under different designs, with different SOPs, using different equipment and protocols etc. If I am not mistaken this is what we are doing when we pool CVs like described here. Note also the distinction between pooling effects, pooling effect ratios (they tend to be homogenous between sites) and pooling variances. I believe GMcP and other pooling proponents do not really allude to the latter? — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-29 18:53 (2250 d 20:42 ago) @ ElMaestro Posting: # 18303 Views: 13,230 |
|
Hi ElMaestro and all, ❝ I will take it in good spirit that for some it can be difficult to accept diverging opinions without lashing out in a personal fashion. My ambition with my everyday dialogue is to keep the conversation on the healthy side of the fine line that separates humor from venomous hints. If I crossed the line, please accept my sincere apologies. ❝ There is no particular scientific reason to assume variance homogeneity for studies done at different times, at different locations, under different designs, with different SOPs, using different equipment and protocols etc. If I am not mistaken this is what we are doing when we pool CVs like described here. I examined data (CVintra of Cmax of MR MPH) from the public domain and some of my studies. Doesn’t matter whether a chiral method is used or not since the in vivo interconversion is negligible. library(PowerTOST) and got this (■ denote CVs > the upper CL of the pooled CV; power for a GMR of 1 in the right margin): ![]() ![]() What we also see: Variability was the highest in study #12 (MR vs. IR), whereas MD (#16) showed only half of the variability of SD (#15) although the accumulation was <1%. For the subset (same product, SD, same analytical method): ![]() Here using the upper CL of the pooled CV would “work” but using the highest CV would be even more conservative. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2018-01-29 20:21 (2250 d 19:14 ago) @ Helmut Posting: # 18304 Views: 13,055 |
|
Just some thoughts:
Study fails? How come? Big surprise.. — Kindest regards, nobody |
ElMaestro ★★★ Denmark, 2018-01-30 19:23 (2249 d 20:13 ago) @ nobody Posting: # 18305 Views: 13,053 |
|
Hi all, well, pooling is good for many things. Not very good for others. Consider also the issue with scaling in BE. We operate on basis of a variance of lnR-lnR, so to say. Not a variance of lnR-lnT or lnT-lnT. But why? - bear in mind that differences in lnT and lnR is accounted for by the fixed effect. It is because the within variance may be heavily formulation dependent. Keep this in mind when you pool different studies. You are potentially throwing a lot of variance of lnT-lnR into the pot from all sorts of different processes and formulations and batches. To me common sense is not pooling variances from different trials. But at least trying to check fi you can relate to the published cases and picking the one you think matches your own conditions best. Yes, the amount of detail may not be enormous in a PAR. Annoying but just a fact of life. The amount of info that you do not have in a set of PARs is scientifically not compensated by pooling of variances. — Pass or fail! ElMaestro |
nobody nothing 2018-01-30 19:31 (2249 d 20:05 ago) @ ElMaestro Posting: # 18306 Views: 13,025 |
|
...mildly (un)related to pooling: Why is the Swedish flag in the forum here so much bigger than the Danish? And Belgium is even smaller than that? Is there no set of average-sized flags out there? ![]() Sorry, but I had to post this one day and this day is today... — Kindest regards, nobody |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-31 02:47 (2249 d 12:49 ago) @ nobody Posting: # 18307 Views: 12,933 |
|
![]() ❝ Why is the Swedish flag ( All flags are scaled to the same height (12 px) in order to match the CSS-properties ul { line-height: 108%; } img.flag { box-shadow: 1px 1px 3px #999; }. The width / height-ratio of flags and their colors are mandated by national laws (not kiddin’ – try this one). The red in the Austrian flag is #EF3340 and the Danish one is #E4002B. ![]() The most common ratio is 3:2, f.i. ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() followed by ones with 2:1, f.i. ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Rare ones: 7:6 ![]() ![]() ![]() ![]() ![]() The only square one ![]() ![]() — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2018-01-31 11:17 (2249 d 04:19 ago) @ Helmut Posting: # 18308 Views: 12,799 |
|
...why not pool all these thing and have them all in 3:2? In real life all this pieces of fabric are of the same size, I guess, when they have a summit, or? ![]() — Kindest regards, nobody |
ElMaestro ★★★ Denmark, 2018-01-31 12:02 (2249 d 03:33 ago) @ nobody Posting: # 18309 Views: 12,788 |
|
❝ ...why not pool all these thing and have them all in 3:2? In real life all this pieces of fabric are of the same size, I guess, when they have a summit, or? Ah yes, harmonisation is usually never a contentious issue. Oh wait, is it spelled 'hamonization'...?!? "Dear Elizabeth, we have had a great idea. Following a discussion on bebac.at - which we are sure you recognize as a leading authority in the field of flags and banners, and not least an incubator for brilliant thoughts - we have decided that as of May 1st 2018, the dimensions of the Union Jack should be 8:5 (width:height). We are sure this little change will not cause any stir of fuss. Please advise your colonies for alignment, change all letterhead throughout the Commonwealth accordingly and make sure to incinerate all current and unused governmental stocks by the aforementioned date. Best regards, Nobody and colleagues PS: We appreciate your efforts to introduce the metric system but we find the process a bit erratic. Can you please get rid of road signs indicating distances in miles? And while you're at it kindly rework your annoying electric plugs and sockets. Your willingness to collaborate is highly appreciated." — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-31 12:16 (2249 d 03:19 ago) @ nobody Posting: # 18310 Views: 12,993 |
|
Hi nobody, ❝ ...why not pool all these thing and have them all in 3:2? I don’t like distortions. ![]() ![]() ![]() ![]() Reminds me on early 16:9 TV-CRTs which scaled the 5:4 PAL making actors looking obese. ❝ In real life all this pieces of fabric are of the same size, I guess, when they have a summit, or? No idea. Politicians don’t give a s**t? — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2018-01-31 12:22 (2249 d 03:13 ago) @ Helmut Posting: # 18311 Views: 12,902 |
|
@Danmark "PPS: and stop driving on the wrong side of the lane..." (off-off-off topic: running low on Karen Wolff Honnungsnitter. Can you help me out?) @Vienna calling: Keep the Swiss and Bhutan as they are. And transform the rest. Pooling at its best. — Kindest regards, nobody |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-31 12:38 (2249 d 02:58 ago) @ nobody Posting: # 18312 Views: 12,890 |
|
Hi nobody, ❝ "PPS: and stop driving on the wrong side of the lane..." … and follow the good example of Sweden which did it on Sep 3, 1967 (the Dagen H – short for Dagen Högertrafikomläggningen). ❝ Keep the Swiss and Bhutan as they are. Don’t mix up Bhutan ( ![]() ![]() ❝ And transform the rest. Pooling at its best. ![]() — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2018-01-31 13:28 (2249 d 02:08 ago) @ Helmut Posting: # 18313 Views: 12,808 |
|
❝ ❝ "PPS: and stop driving on the wrong side of the lane..." ❝ ❝ … and follow the good example of Sweden which did it on Sep 3, 1967 (the Dagen H – short for Dagen Högertrafikomläggningen). Nowadays other "Höger" problems... ❝ ❝ Keep the Swiss and Bhutan as they are. ❝ ❝ Don’t mix up Bhutan ( Me idi*t! I appologize and will climb Annapurna twice, to make up for my fault... ❝ ❝ And transform the rest. Pooling at its best. ❝ ❝ Which sims in R could I do to convince you? These uneven flags are a no-go! :-p — Kindest regards, nobody |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-31 18:18 (2248 d 21:17 ago) @ nobody Posting: # 18316 Views: 12,897 |
|
❝ ❝ Don’t mix up Bhutan ( ❝ ❝ Me idi*t! I appologize and will climb Annapurna twice, to make up for my fault... Why not the Sagarmatha/Chomolungma? Much safer than the Annapurna with its death rate of 25%. Climb it twice? ❝ Which sims in R could I do to convince you? Finding an adjusted α for reference-scaling performed in a two-stage design. Do you have access to a supercomputer or at least a large Linux-cluster? ❝ These uneven flags are a no-go! :-p Sorry. You have to learn to live with them. Optionally: Switch off graphics in your brause. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2018-01-31 18:32 (2248 d 21:04 ago) @ Helmut Posting: # 18317 Views: 12,724 |
|
❝ ❝ ❝ Don’t mix up Bhutan ( ❝ ❝ ❝ ❝ Me idi*t! I appologize and will climb Annapurna twice, to make up for my fault... ❝ ❝ Why not the Sagarmatha/Chomolungma? Much safer than the Annapurna with its death rate of 25%. Climb it twice? Just 25%? Only about 160 people made it. Entleibung, the hard way... ❝ ❝ Which sims in R could I do to convince you? ❝ ❝ Finding an adjusted α for reference-scaling performed in a two-stage design. Do you have access to a supercomputer or at least a large Linux-cluster? Son is studying computer stuffffs, maybe some years ![]() ❝ ❝ These uneven flags are a no-go! :-p ❝ ❝ Sorry. You have to learn to live with them. Optionally: Switch off graphics in your brause. You are mean! — Kindest regards, nobody |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2018-01-31 20:00 (2248 d 19:36 ago) @ nobody Posting: # 18318 Views: 12,867 |
|
Hi nobody, ❝ ❝ ❝ Which sims in R could I do to convince you? ❝ ❝ ❝ ❝ Finding an adjusted α for reference-scaling performed in a two-stage design. Do you have access to a supercomputer or at least a large Linux-cluster? ❝ ❝ Son is studying computer stuffffs, maybe some years CRAN Task View: High-Performance and Parallel Computing with R ❝ ❝ Sorry. You have to learn to live with them. Optionally: Switch off graphics in your brause. ❝ ❝ You are mean! I’m afraid, yes. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |