Software validation – again and again [Power / Sample Size]

posted by Helmut Homepage – Vienna, Austria, 2019-03-20 12:12 (580 d 20:23 ago) – Posting: # 20053
Views: 3,898

Hi sury,

» we have not yet finalized the SOP, and moreover we use the SAS Software procedure "PROC POWER" for the estimation of the sample size.


» But however we wanted it to be more accurate sample size for that we want to include the deletti tables.

I wonder why you were asking here for the Diletti tables. The reference is readily available in the manual of Proc POWER
Proc POWER employs Owen’s Q-function1 – as does PowerTOST by default. AFAIK, OwenQ is a still undocumented function in SAS… Proc POWER is available in SAS since v9.1 (2003). Hence, Diletti et al. wrote in 1991:

The exact form of these integrals and an algorithm for their calculation has been provide by Owen; this algorithm has been implemented to create the figures and tables in this paper.

We don’t know which software and code they used. Edgar Diletti and Volker Steinijans are retired; ask Dieter Hauschke.

» » These tables […] are hopelessly behind state of the art!
» » » NB, if you are interested in reference-scaling […]»
» Yes

For all reference-scaling methods you need simulations and have to write your own SAS-code. Expect run-times of many, many hours. The two Lászlós wrote their code in MATLAB, which is only slightly faster than SAS. Hence, for years they recommend PowerTOST themselves.

» » Hence, I strongly suggest […] package PowerTOST.
» yes we are thinking to opt this package. But however we have a concern whether regulatory will accept it or not.
» By then we are doubtfull of using this package.

Since PowerTOST is open source you (or an [image]-expert) can perform a white-box validation. Additionally, PowerTOST contains not only reference data sets from the literature but also scripts to validate your installation. See also this thread.
Maybe you are interested in this document.2

» Sometime ago I have faced the concern regarding the Software validation from the regulatory.

Any software used in a GCP-environment has to be validated. Have you done that with SAS?* No, I don’t mean just IQ, OQ, PQ! Good luck with commercial software where the source code (allowing white-box validation) is not accessible. You could only perform cross-validation (black-box) with reference data sets. If you don’t have more than one software at hand, you have to believe (!) that what is reported for the reference data set is correct.

  1. Owen DB. A special case of a bivariate non-central t-distribution. Biometrika. 1965;52(3/4):437–46. doi:10.2307/2333696.
  2. The R Foundation for Statistical Computing. R: Regulatory Compliance and Validation Issues. A Guidance Document for the Use of R in Regulated Clinical Trial Environments. Vienna, March 2018. [image] open access.

Dif-tor heh smusma 🖖
Helmut Schütz

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes

Complete thread:

 Admin contact
21,170 posts in 4,411 threads, 1,475 registered users;
online 9 (0 registered, 9 guests [including 2 identified bots]).
Forum time: Wednesday 09:36 CEST (Europe/Vienna)

But it is in matters beyond the limits of mere rule
that the skill of the analyst is evinced.
He makes in silence a host of observations and inferences…    Edgar Allan Poe

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz