Shuanghe ★★ Spain, 2016-01-25 18:49 (3344 d 11:53 ago) Posting: # 15852 Views: 19,760 |
|
Hi all, I just noticed some strange result when I was making sample size plot for FDA full replicate BE using Detlew's famous PowerTOST. My understanding was that, with T/R ratio fixed (e.g., 90%), when ISCV increase from, say, 10% to 100%, sample size will increase with the increasing ISCV and reach a peak at ISCV=30% then sample size will decrease due to widened BE criteria and after a certain point size will increase again due to high variability. This is true when I tried T/R ratio of 95% or 90%. For example, this plot. ![]() However, when I was trying T/R ratio of 85% (I know, weird and problematic ratio assumption for BE. Don't ask why. Let's just say that I had to do it), the size peak reached at ISCV=27-28%, not at 30%. See this picture. ![]() Why is that? Since all other assumptions are same (e.g., T/R ratio is still 85%), when ISCV increased from e.g., 28% to 29% and 30%, shouldn't we need more subjects as the BE criteria is not widened yet? If my understanding is correct, then maybe it's a bug of the package? If I'm wrong, could anyone explain it in plain English ![]() Edit: Category changed. [Helmut] — All the best, Shuanghe |
d_labes ★★★ Berlin, Germany, 2016-01-26 13:05 (3343 d 17:37 ago) @ Shuanghe Posting: # 15853 Views: 17,895 |
|
Dear Shuange! ❝ Why is that? The why is not so easy to answer. It is a result of a complex interplay of the dependence of the linearized RSABE criterion from GMR and CVwR and of the additional point estimate constraint. My suggestion: Take the observed effect as is ![]() ❝ Since all other assumptions are same (e.g., T/R ratio is still 85%), when ISCV increased from e.g., 28% to 29% and 30%, shouldn't we need more subjects as the BE criteria is not widened yet? "Not widened yet" is the false. Think from the underlying method - simulation of studies with true CV and true GMR = theta0. And think further in terms of widened acceptance limits: If we simulate with CV=30% we have realizations where the implied acceptance limits are wider and others where the conventional acceptance limits have to be used. The probability of both studies is 0.5. If we go to smaller CV's the proportion with wider implied acceptance limits decreases. For higher CV's we get more studies with wider implied acceptance limits. So far so good. This doesn't imply that at CV=30% the sample size is highest since we have the point estimate constraint in effect. This leads to the shift of the maximum sample size downwards of 30%. This is also the case for your calculations with theta0=0.9, but not so pronounced seen as with theta0=0.85. Check it by power calculations with n=120 for theta0=0.85 or theta0=0.9 and n=32. You will find the minimum (implying max. sample size) below CV=30% in both cases. ❝ If my understanding is correct, then maybe it's a bug of the package? Of course not! Even the suspicion is an injury ![]() It must be correct because PowerTOST says so ![]() Count up: post 995 — Regards, Detlew |
Shuanghe ★★ Spain, 2016-01-26 13:55 (3343 d 16:47 ago) @ d_labes Posting: # 15854 Views: 17,745 |
|
Many thanks Detlew! ❝ "Not widened yet" is the false. ... ❝ ❝ So far so good. This doesn't imply that at CV=30% the sample size is highest since we have the point estimate constraint in effect. This leads to the shift of the maximum sample size downwards of 30%. Understood until here. ❝ This is also the case for your calculations with theta0=0.9, but not so pronounced seen as with theta0=0.85. Check it by power calculations with n=120 for theta0=0.85 or theta0=0.9 and n=32. You will find the minimum (implying max. sample size) below CV=30% in both cases. Confused by this part. ![]() ❝ The why is not so easy to answer. ... My suggestion: Take the observed effect as is I think I'll just take what it is as you said. Much easier this way ![]() ❝ Of course not! Even the suspicion is an injury ❝ It must be correct because PowerTOST says so ![]() ![]() — All the best, Shuanghe |
d_labes ★★★ Berlin, Germany, 2016-01-26 15:07 (3343 d 15:35 ago) @ Shuanghe Posting: # 15855 Views: 17,784 |
|
Dear Shuanghe, ❝ Many thanks Detlew! You are welcome. ❝ ❝ This is also the case for your calculations with theta0=0.9, but not so pronounced seen as with theta0=0.85. Check it by power calculations with n=120 for theta0=0.85 or theta0=0.9 and n=32. You will find the minimum (implying max. sample size) below CV=30% in both cases. ❝ ❝ Confused by this part. What I tried to say here with my Swahili: Your first picture / calculations with T/R ratio 0.9, which you have considered as ok, also has the effects inherent you wondered about with T/R ratio 0.85 but to a lesser not so obvious degree if you look at the sample size. Count up: post 996 — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2016-01-26 17:31 (3343 d 13:11 ago) @ Shuanghe Posting: # 15856 Views: 17,772 |
|
Dear Shuanghe, adding a few lines of code to what Detlew wrote.
The maximum sample size within each GMR-column shows this strange behavior due the FDA’s combination of the regulatory constant log(1.25)/0.25, the PE-restriction, and the discontinuity (since RSABE can only be applied if CVwR ≥0.30). In the n-matrix you find the same maximum sample sizes in some GMR-columns. As Detlew pointed out, you can look at the minimum power to decide which one to select. ![]() Interesting shape! — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
nobody nothing 2016-01-26 18:40 (3343 d 12:02 ago) @ Helmut Posting: # 15857 Views: 17,769 |
|
❝ Interesting shape! Again and again I ask myself why reg agencies in year 2016 are allowed to impose such "scientific guidelines" drawn out of the as.. ehhhm, clear blue sky without doing such exploratory scientific work as presented here. It is a shame, with all the money going around in this industry. And academia appears not to be interested in such profane things. — Kindest regards, nobody |
d_labes ★★★ Berlin, Germany, 2016-01-27 09:41 (3342 d 21:01 ago) @ Helmut Posting: # 15859 Views: 17,267 |
|
Code Masta! ❝ ... ❝ Interesting shape! Strange! Although I must confess that I don't really understand what this story tells. (Ubiquitous question from German language teachers: "Was will der Dichter uns damit sagen?", google translate: "What does the poet to tell us?") Count up: post 997 — Regards, Detlew |
nobody nothing 2016-01-27 10:08 (3342 d 20:35 ago) @ d_labes Posting: # 15860 Views: 17,542 |
|
To me this Fig. tells the story that for GMR < 0.92 frequently the max n is reached BELOW the cut-off of 30% for CV. With a somewhat strange distribution at the very low (not relevant?) end for GMR... I would like to think about somefink like this FIRST, before enforcing such policies.... — Kindest regards, nobody |
d_labes ★★★ Berlin, Germany, 2016-01-27 10:31 (3342 d 20:11 ago) @ nobody Posting: # 15861 Views: 17,343 |
|
Dear nobody, ❝ I would like to think about somefink like this FIRST, before enforcing such policies.... Just to repeat an ancient rule (10 years ago!) of our Admin of this forum (see here): STOP — THINK — ACT ![]() Count up - post 998 — Regards, Detlew |
Shuanghe ★★ Spain, 2016-01-28 13:44 (3341 d 16:58 ago) @ Helmut Posting: # 15875 Views: 17,279 |
|
Dear Helmut and Detlew, ❝ What I tried to say here with my Swahili: ...... ❝ adding a few lines of code to what Detlew wrote. ❝ ...... Now I understand it. I also noticed similar effect when I was playing sample size for power of 90%, without the wonder code like Helmut's of course ![]() Many thanks. — All the best, Shuanghe |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2016-01-28 14:49 (3341 d 15:53 ago) @ Shuanghe Posting: # 15879 Views: 17,507 |
|
Dear Shuanghe and Detlew, ❝ I also noticed similar effect when I was playing sample size for power of 90%, without the wonder code like Helmut's of course Target power 90%: ![]() @Detlew: In my code I had to arbitrarily increase nstart in the second attempt, i.e., to
CV=0.305 , theta0=0.82 nlast is 442. With nstart=nlast the algo stops again (n 644, power 0.89243). Currently in line 159 of the source-code imax is fixed with 100. What do you think about introducing imax as an argument like in sampleN.TOST() ?— Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2016-02-01 20:16 (3337 d 10:27 ago) @ Helmut Posting: # 15909 Views: 17,186 |
|
Dear Helmut, ❝ @Detlew: In my code I had to arbitrarily increase ❝ ❝ details=FALSE, nstart=x[["nlast"]]*1.5) ❝ because for ❝ With your wish is my command. Yes, I know that the starting values of the sample size search in such extreme settings as you are using here is not always good enough to come to a result. Introducing an argument imax makes for the functions sampleN.scABEL() or sampleN.RSABE() more sense than for sampleN.TOST() itself. For the latter the starting values are generally good enough to achieve the sample size within at max. 10 iterations or so. Usually a lower number is required.The update will need some time. In the meantime I suggest to change your code to allow more then two tries to obtain a sample size from sampleN.scABEL() or sampleN.RSABE() if you need the functionality in the near future.Sumefink like: ... Maybe it would be a good idea to introduce additionally a counter in the while loop with reaching a maximum will break that loop. — Regards, Detlew |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2016-02-01 22:49 (3337 d 07:53 ago) @ d_labes Posting: # 15910 Views: 16,949 |
|
![]() ❝ your wish is my command. Don’t hurry. I’m grateful for your gift to the community, PowerTOST and your contributions to the forum in the last eight years.Congratulations to your post #1,000! Only 116 to catch up with ElMaestro. ![]() — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2016-02-02 22:17 (3336 d 08:25 ago) @ Helmut Posting: # 15920 Views: 16,952 |
|
Dear Helmut, ❝ ... I’m grateful for your gift to the community, Thank you for the flowers. But my contribution to the community would have been NIL if I hadn't discovered this forum back in the year 2008, if I recall it exactly. Thanks Admin of the BE/BA forum. ❝ ... Only 116 to catch up with ElMaestro. I will hunt our Ol'Captain until he will give up ![]() ❝ You are guilty for almost 50% of posts from Germany. Do you feel lonely? The last statement is really more than true, although nobody is close on my heels ![]() But I would be really glad if more substantial contributors would discuss here in the forum, from which country ever. Thus that the Forum is not like the answer machine "Ask Sam". In summary: Thanks to all contributors. Thanks to all critical reviewers of my posts or of my baby PowerTOST . Lets continue in this exchange of ideas or implementation details in whatever programming language ever. First of all in R, since it's free ![]() I will try to stay tuned, although as pensioner (German pronounced reindeer) since start of the year 2016 I will never ever have spare time enough ![]() — Regards, Detlew |
ElMaestro ★★★ Denmark, 2016-02-03 17:32 (3335 d 13:10 ago) @ Helmut Posting: # 15924 Views: 16,760 |
|
Hi d_labes, ❝ Congratulations to your post #1,000! Only 116 to catch up with ElMaestro. I likewise applaud you for your frequent expert contributions which I have learned a lot from. When I posted my post #1000 I received from Bebac in Vienna a golden watch and a 3-week trip to Fiji with my wife, our 7 kids, and my personal assistant (NLYW) in a 5* hotel. In addition Hötzi bribed some Viennese city officals to rename a street after me, that's the reason you can now stroll down ElMaestro-Gasse (formerly called Mariahilfer Strasse, but that was way too complicated to pronounce anyway). I am looking forward to hearing how you are rewarded. Keep up the good work. ![]() — Pass or fail! ElMaestro |
Helmut ★★★ ![]() ![]() Vienna, Austria, 2016-02-03 17:50 (3335 d 12:52 ago) @ ElMaestro Posting: # 15925 Views: 16,976 |
|
Hi ElMaestro, ❝ In addition Hötzi bribed some Viennese city officals to rename a street after me, that's the reason you can now stroll down ElMaestro-Gasse (formerly called Mariahilfer Strasse, but that was way too complicated to pronounce anyway). Oh, didn’t know that I succeeded at the end. Will have a look. Google tells me that it would take me four minutes to go there. — Dif-tor heh smusma 🖖🏼 Довге життя Україна! ![]() Helmut Schütz ![]() The quality of responses received is directly proportional to the quality of the question asked. 🚮 Science Quotes |
d_labes ★★★ Berlin, Germany, 2016-02-05 16:50 (3333 d 13:52 ago) @ ElMaestro Posting: # 15934 Views: 16,656 |
|
Dear Ol#Pirate! ❝ I am looking forward to hearing how you are rewarded. Keep up the good work. First: THX for your applause. Second: The reward for the 1000 post was obviously only for the First reaching that goal. As Michail Gorbatschow has said: "Wer zu spät kommt den bestraft das Leben" (Those who are late will be punished by life itself) ![]() Regarding naming a street after you I could do better: I have gotten a whole city, now in Poland known as Łobez ![]() — Regards, Detlew |
ElMaestro ★★★ Denmark, 2016-02-05 18:02 (3333 d 12:40 ago) @ d_labes Posting: # 15935 Views: 16,603 |
|
Dear Detlew, ❝ Regarding naming a street after you I could do better: I have gotten a whole city, now in Poland known as Łobez Then how about this ? — Pass or fail! ElMaestro |
d_labes ★★★ Berlin, Germany, 2016-02-05 20:48 (3333 d 09:54 ago) @ ElMaestro Posting: # 15936 Views: 16,587 |
|
Dear Mr. Birdsong! Can you send me a large box of this delectable drink ![]() — Regards, Detlew |
ElMaestro ★★★ Denmark, 2016-02-06 16:45 (3332 d 13:57 ago) @ d_labes Posting: # 15938 Views: 16,627 |
|
De Detlew, ❝ Can you send me a large box of this delectable drink There's nothing I would rather do. You'd be properly acquainted with Danish culture. Nevertheless, due to EU and rules and bureacracy and sh!t it seems quite impossible. If I am invited to the Berlin area some time in 2016 (Informa, the annual Inhalation event?!) then I will see if I can arrange something. It is good stuff, you have something to look forward to. Alternatively, you could start your big Mercedes and drive to Denmark and pick a few cases up at my address. Beaches, fresh air, sun, ocean, NLYWs playing beach volley, HC Andersen fairytales, Lego, and good beer... There are so many reasons to go here. Also Die Olsenbande. Much revered in the former East Germany ![]() ![]() ![]() — Pass or fail! ElMaestro |
nobody nothing 2016-02-07 10:50 (3331 d 19:53 ago) @ ElMaestro Posting: # 15940 Views: 16,426 |
|
... and drive to Denmark and pick a few cases up at my address... Reminder: Don't forget your ID-card and beware of the harsh looking border police. Welcome to Europe 2016... ![]() ![]() — Kindest regards, nobody |