forced BE? [Design Issues]

posted by Helmut Homepage – Vienna, Austria, 2017-08-04 17:51 (2428 d 05:19 ago) – Posting: # 17665
Views: 15,780

Hi David & VSL,

sorry for excavating an old thread. :-D

❝ […] from my knowledge of the portuguese regulators, there is a lack of members with statistical expertise to properly assess the adequacy of the sample size, or any other question regarding statistical methods, either in Ethics Committees or the regulator.


According to Directive 2005/28/EC (6)

Provisions for the functioning of the Ethics Committees should be established in each Member State on the basis of common detailed guidelines, in order to ensure the protection of the trial subject while at the same time allowing a harmonised application in the different Member States of the procedures to be used by Ethics Committees.

Hence, ECs are set up according to National laws. E.g., in Austria acc. to §41 of the Medicines Law (my translation):Similar in Germany’s Medicines Law §41a(2)

[…] interdisciplinary composition of the ethics committee involving at least one lawyer, one person with scientific or professional experience in the field of ethics in medicine, one person with experience in the field of experimental planning and statistics, three physicians who have experience in clinical medicine, including a specialist in clinical pharmacology or pharmacology and toxicology, as well as a layperson.

Which are the rules for ECs in Portugal? BTW, I know some members of the Portuguese Agency whose knowledge of statistics is excellent.
It can even be that the EC is more knowledgeable than an agency. Happened to me. Joachim Röhmel (one of the pioneers of adaptive designs) is a member of the EC of Berlin. He was very happy with my first study in a Two-Stage Design. Later I learned that the Dutch MEB didn’t like (‼) it.

❝ In my plans for 2018, I will attempt to meet with the portuguese regulator so they can gave me access to their approved studies in bioequivalence in the last years …


Wow! Do you think that’s possible?

❝ ❝ I have seen post analysis power more than 90% in many studies. If you ask biostatisticians, they say, we don't know, it comes, no justification is required as the study has passed.


❝ … so I can quantify the degree of overpowering of bioequivalence studies when compared to the observed CV and the predicted/guessed/magically obtained predicted CV.


Is that reasonable? You may fall into the trap of post hoc power.1 We know that θ0 and CV used in designing the study are assumptions or, at best, estimates. The applicant might have used conservative values.2 If the GMR turns out to be “better”, the CV and/or the dropout-rate lower than expected you will face high post hoc power. But this does not necessarily imply that the study was some kind of “forced bioequivalence”.

❝ My intent is to publish a paper with that information …


Great. But given what I wrote above, IMHO, it will not be sufficient to solely plugin the numbers. You have to dive into the protocol and report in order to get insights about what was going on.

❝ … and to sensitize regulators and ethics committees to this issue, which mixes both the sample size calculation and the adequacy of the study design in light of the available information.


Good! Members of an EC are in a difficult situation. There is no database giving the sample sizes of studies performed with a particular reference. I guess in many cases the assessment would require a member with a good memory. If he/she/it has seen studies of drug X with sample sizes of, say ~32 subjects and the protocol suggests 120, that should ring the alarm bells. I think it is difficult to draw the line.


  1. Hoenig JM, Heisey DM. The Abuse of Power. The Pervasive Fallacy of Power Calculations for Data Analysis. Am Stat. 2001;55(1):19–24. doi:10.1198/000313001300339897. [image] free resource.
  2. Not conservative but a waste of money & unethical: I know one company, which for years – when they had no clue about the CVw – simply used s∕x reported for the reference. No crossover, total CV instead of CVw. They called it “in order to be on the safe side”. Well, … In the meantime they opt for pilots or TSDs.

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Complete thread:

UA Flag
Activity
 Admin contact
22,957 posts in 4,819 threads, 1,636 registered users;
90 visitors (0 registered, 90 guests [including 8 identified bots]).
Forum time: 22:10 CET (Europe/Vienna)

Nothing shows a lack of mathematical education more
than an overly precise calculation.    Carl Friedrich Gauß

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5