Validation of PhEq_bootstrap [Software]

posted by Shuanghe  – Spain, 2018-07-17 15:54 (1166 d 15:47 ago) – Posting: # 19077
Views: 9,149

Hi Helmut!

» Now for the bad news. There is one thing stupid in the software when it comes to validation (line 535 of the source Conv_to_learn1.pas):

RandSeed:=random(random(1000000))+random(random(1000000));

That means that the seed of the (pseudo)random number generator is always a random number itself. Therefore, it is impossible to reproduce runs. Try it: you will not get exactly my results.
What a coincidence! I was in a meeting recently with a regulatory agency and the issue of reproducibility came up since the agency couldn't reproduce the bootstrap f2 values we reported in the dossier. My first thought was the different seed number. I opened the source files one by one and searched words like random, seed, to get the line. :-D

» IMHO, that’s bad coding practice.

Indeed. End user should be able to specify the seed number to be able to reproduce the analysis. I always leave a variable for seed number in my SAS code for bootstrap of BE data.
—
All the best,
Shuanghe

Complete thread:

Activity
 Admin contact
21,699 posts in 4,537 threads, 1,542 registered users;
online 5 (1 registered, 4 guests [including 3 identified bots]).
Forum time: Sunday 07:42 CEST (Europe/Vienna)

A central lesson of science is that to understand complex issues
(or even simple ones), we must try to free our minds of dogma and
to guarantee the freedom to publish, to contradict, and to experiment.
Arguments from authority are unacceptable.    Carl Sagan

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5