0521
☆    

China,
2018-11-09 08:02
(1966 d 03:48 ago)

Posting: # 19550
Views: 9,213
 

 Question:Using Phoenix WinNonlin Crossover object for Tmax test [Nonparametrics]

Dear Helmut Schütz,

When using Phoenix WinNonlin Crossover object for Tmax testing, how can I judge whether it is equivalent by the result? :confused:

I read the "The Use Of Non-Parametric Methods In The Statistical Analysis" document (PMID: 4556704), and I think he is doing the following steps to judge:

1. Determine if the P value of the sequence is greater than 0.05,
2. If the P value of the sequence is less than 0.05, the test of "Treatment" cannot be performed.
3. If the P value of the sequence is greater than 0.05, it is judged whether the P value of the treatment is greater than 0.05.
4. If the P value of the Treatment is greater than the equivalent, otherwise it is not equivalent.

5. If the P value of the sequence and the P value of the Period are both greater than 0.05, a sign test can be used instead of the rank sum test used in the above steps.

Assuming α = 0.05, all of the above P values are the results in the "Effects" table.

Is the above judgment process correct? :confused:
If not, what is the correct judgment process? :confused:

PARAMETER  Test                                T_stat    L_stat   p_Value
Tmax       Sequence                            177.5              0.91791649
Tmax       Treatment|(SEQ1=SEQ2)                 220             0.021731156
Tmax       Period|(SEQ1=SEQ2)                    185              0.62428829
Tmax       Treatment & Residual (simultaneous)        5.6567621  0.059108471


[image]

Best,

0521
mittyri
★★  

Russia,
2018-11-11 01:21
(1964 d 10:30 ago)

@ 0521
Posting: # 19561
Views: 6,990
 

 Phoenix WinNonlin Crossover object for Tmax test

Dear 0521,

❝ Dear Helmut Schütz,

Not interested in other opinions? :-D

❝ I read the "The Use Of Non-Parametric Methods In The Statistical Analysis" document(PMID: 4556704)

Good start!

❝ 1. Determine if the P value of the sequence is greater than 0.05,

It depends on the significance level you've chosen (p). WNL cannot do that for you.
no sequence effect (or drug residual effect) in WNL terminology.

❝ 2. If the P value of the sequence is less than 0.05, the test of "Treatment" cannot be performed.

No treatment effect given no sequence effect in WNL terminology.
I would follow the text of the article you referred:
Finally, it is appropriate to note here that if the residual effects cannot be deleted from the model, then the test procedures described in section 3.2 and 3.3 are no longer valid
Corresponding sequence test (unequal carry-over) in ANOVA couldn't be a reason for analysis interruption. Likely unequal carryover doesn’t exist in a properly designed study (sufficiently long washout), hence false positives could happen.

❝ 3. If the P value of the sequence is greater than 0.05, it is judged whether the P value of the treatment is greater than 0.05.

❝ 4. If the P value of the Treatment is greater than the equivalent, otherwise it is not equivalent.

Significant != not Equivalent and vice versa! That's why we are using confidence intervals, not p-values in our BE decisions.

❝ 5. If the P value of the sequence and the P value of the Period are both greater than 0.05, a sign test can be used instead of the rank sum test used in the above steps.

You omit
3.3 Testing the equality of period effects when residual effects are absent
3.4 Testing the equality of direct effects and residual effects simultaneous
([no period effect given no sequence effect] and [no treatment and no sequence effect] in WNL terminology)
Yes, it could, but WNL does the trick with 3.4:
Since the bivariate Wilcoxon test requires only an ordinal scale for ranking across subjects, it should be used instead of the sign test for general situations in which residual and/or period effects are unequal and within subject linear functions are invalid.

Using the p-values from the Effects sheet is the same as using p-values from ANOVA: good exploratory analysis without any credible conclusions regarding bioequivalence.
It is better to compare CIs to some reference limits as Helmut noted here.

Kind regards,
Mittyri
0521
☆    

China,
2018-11-11 11:56
(1963 d 23:54 ago)

(edited by mittyri on 2018-11-11 23:05)
@ mittyri
Posting: # 19562
Views: 7,280
 

 Phoenix WinNonlin Crossover object for Tmax test

❝ Not interested in other opinions? :-D

Thank you very much for your reply, I welcome anyone to reply to this post.:-)

❝ ❝ I read the "The Use Of Non-Parametric Methods In The Statistical Analysis" document(PMID: 4556704)

❝ Good start!


This paper is a reference to the Crossover object in the WinNonlin User Guide.

So I think I should follow the paper to interpret the results of the WinNonlin Crossover object.

❝ ❝ 1. Determine if the P value of the sequence is greater than 0.05,

❝ It depends on the significance level you've chosen (p). WNL cannot do that for you.


I assume that the significance level is 0.05.

no sequence effect (or drug residual effect) in WNL terminology.

[image]

Does the first row of the effects sheet not indicate a test for sequence effects?

❝ ❝ 2. If the P value of the sequence is less than 0.05, the test of "Treatment" cannot be performed.

No treatment effect given no sequence effect in WNL terminology.

[image]

Does the second row of the effects sheet not indicate a test for treatment effects?

❝ I would follow the text of the article you referred:

Finally, it is appropriate to note here that if the residual effects cannot be deleted from the model, then the test procedures described in section 3.2 and 3.3 are no longer valid

❝ Corresponding sequence test (unequal carry-over) in ANOVA couldn't be a reason for analysis interruption. Likely unequal carryover doesn’t exist in a properly designed study (sufficiently long washout), hence false positives could happen.

Although I also think that the residual effect can not be used as a reason for the interruption test,
However, for this paper, 3.2 and 3.3 depend on 3.1, and only after the 3.1 test is passed, the tests of 3.2 and 3.3 can be performed.

❝ ❝ 4. If the P value of the Treatment is greater than the equivalent, otherwise it is not equivalent.

❝ Significant != not Equivalent and vice versa! That's why we are using confidence intervals, not p-values in our BE decisions.

I agree.

Do you want to tell me this:-):
1. In the effect sheet, the P value judgment of the Treatment is independent of the sequence and the period.
2. All P values in the effect sheet are only statistically significant. The P value has no substantial clinical significance and should not be overly concerned. We should pay more attention to the results in the Confidence Intervals sheet.
3. For the effect sheet, we should pay attention to whether the median of Treatment_Diff_( T - R ) has clinical significance.

Other questions:confused::
1. For the nonparametric test of Tmax, is the only way to calculate the P value using "Mann–Whitney U test"?:confused:
2. For the non-parametric test of Tmax, can we use the "Wilcoxon signed rank test" to calculate the P value?:confused:
3. For the effect sheet, is the "Conclusion_Diff_(T - R)" confidence interval "0" necessary?:confused:

Edit: Full quote removed. Please delete everything from the text of the original poster which is not necessary in understanding your answer; see also this post #5[Mittyri]
mittyri
★★  

Russia,
2018-11-12 00:21
(1963 d 11:29 ago)

@ 0521
Posting: # 19563
Views: 6,892
 

 Tmax Hypothesis testing

Hi,

❝ I assume that the significance level is 0.05.


Note that this is your assumption, not WNL

❝ Does the first row of the effects sheet not indicate a test for sequence effects?


It indicates.

❝ Does the second row of the effects sheet not indicate a test for treatment effects?


It indicates.

❝ Although I also think that the residual effect can not be used as a reason for the interruption test,

❝ However, for this paper, 3.2 and 3.3 depend on 3.1, and only after the 3.1 test is passed, the tests of 3.2 and 3.3 can be performed.


WNL is software, not all-mighty wisdom. Only YOU can decide whenever it is possible to delete residual effects from the model and take into account that rows.

❝ 1. In the effect sheet, the P value judgment of the Treatment is independent of the sequence and the period.


The treatment is dependent on Sequence only, not period, as authors of paper mentioned (see above). It is, IF you cannot neglect unequal carry-over, you cannot test Treatment (3.2), but can try bivariate Wilcoxon statistic (3.4).

❝ 2. All P values in the effect sheet are only statistically significant. The P value has no substantial clinical significance and should not be overly concerned. We should pay more attention to the results in the Confidence Intervals sheet.


It depends on the Hypothesis you are stating in the Protocol.

❝ 3. For the effect sheet, we should pay attention to whether the median of Treatment_Diff_( T - R ) has clinical significance.


and related to the hypothesis you are testing.

❝ 1. For the nonparametric test of Tmax, is the only way to calculate the P value using "Mann–Whitney U test"?:confused:


Obiously not. You can use any test aplicable for ordinal data with scientific justification.

❝ 2. For the non-parametric test of Tmax, can we use the "Wilcoxon signed rank test" to calculate the P value?:confused:


Sure, you can. Just keep in mind that you are neglecting period/sequence effects. It tests the within-subject treatment differences against zero and is therefore a non-parametric analogon of the paired Student t-test (see the link to the discussion above in the previous post).

❝ 3. For the effect sheet, is the "Conclusion_Diff_(T - R)" confidence interval "0" necessary?:confused:


Cannot get the question

Kind regards,
Mittyri
0521
☆    

China,
2018-11-12 08:15
(1963 d 03:35 ago)

@ mittyri
Posting: # 19564
Views: 6,720
 

 Tmax Hypothesis testing

Dear Mittyri,

Your reply is very helpful.

I hope that I can fully understand what you mean, so I hope that I can repeat your point of view with my own words:

1. The meaning of the value of P should be stated in the hypothesis of my Protocol and set a significant level α, which I assume here α = 0.05:-).

2. For the Tmax test, I can use any test method for ordinal data as long as there is scientific evidence.

3. If I use the method of the paper to test Tmax, only the "3.2 treatment test" is meaningful when the P value of the "3.1 sequence test" sequence effect is >0.05. such as,
Scene 1: P value of sequence effect = 0.6, P value of treatment effect = 0.6
Scene 2: P value of sequence effect = 0.6, P value of treatment effect = 0.01
Scene 3: P value of sequence effect = 0.01, P value of treatment effect = 0.6
Scene 4: P value of sequence effect = 0.01, P value of treatment effect = 0.01
Among the above four scenarios, only the treatment effect of scene 1 is not significantly different.
Only the therapeutic effects of Scene 2 are significantly different,
Scene 3 and Scene 4 cannot determine whether the treatment effect is significantly different.

4. If I use the paper method to test Tmax, and if the P value of the "3.1 Sequence Test" sequence effect is <0.05, then I should use the "3.4 Treatment & Residual (simultaneous) test" instead of "3.2 treatment test".

5. I must assume that there is no significant difference between the sequence effect and the pairing effect before the "Wilcoxon signed rank test" method can be used.

6. Does it mean that the method in the paper as a whole is more extensive than the data applied by the "Wilcoxon signed rank test". In other words, the method in the paper has fewer assumptions than the "Wilcoxon signed rank test".:confused:

Kind regards,
0521
mittyri
★★  

Russia,
2018-11-16 23:52
(1958 d 11:58 ago)

@ 0521
Posting: # 19641
Views: 6,720
 

 neglecting periods for Tmax

Dear 0521,

❝ 3. If I use the method of the paper to test Tmax, only the "3.2 treatment test" is meaningful when the P value of the "3.1 sequence test" sequence effect is >0.05

Citing Hauschke et al.1):
When assessing treatment effects, the fundamental assumption is the absence of carryover effects, which would again imply a reformulation of the test problem to ensure applicability of a direct test approach. For the sake of simplicity, it has been proposed to use a more liberal significance level for the above test, for example p = 0.10; see also Jones and Kenward (2003) for a further discussion of this indirect approach. A direct approach for testing the absence of a relevant difference in carryover effects has been proposed by Wellek (2003). However, as discussed later in Chapter 4, carryover effects can be excluded in bioequivalence studies based on medical grounds since healthy volunteers are recruited and an adequate washout has to be chosen.


❝ 6. Does it mean that the method in the paper as a whole is more extensive than the data applied by the "Wilcoxon signed rank test". In other words, the method in the paper has fewer assumptions than the "Wilcoxon signed rank test".:confused:

Well, I would say to neglect period effects after Hauschke2) proposal is out of date.


1 Hauschke D, Steinijans VW and Pigeot I.
Bioequivalence studies in drug development methods and applications. John Wiley & Sons, New York (2007).
2 D. HAUSCHKE, V. W. STEINIJANS and E. DILETTI
A distribution-free procedure for the statistical analysis of bioequivalence studies
International Journal of Clinical Pharmacology, Therapy and Toxicology,
Vol. 28 No. 2 -1990 (72-78) / Vol.30, Suppl. No. 1 -1992 (pp,S37-43)

Kind regards,
Mittyri
amritp49
☆    

India,
2019-12-18 17:12
(1561 d 18:38 ago)

@ mittyri
Posting: # 20995
Views: 4,615
 

 Tmax Hypothesis testing

Hi

mam

Hope you are doing well.
I was looking for winnonlin software. I mean we have some data to analyze in winnonlin software. so if we can send our data to analyze on payment basis.


Edit: No commerical stuff in the forum, please. I activated the e-mail function in your profile so that other users can contact you. [Helmut]
Helmut
★★★
avatar
Homepage
Vienna, Austria,
2019-12-18 17:44
(1561 d 18:06 ago)

@ amritp49
Posting: # 20996
Views: 4,608
 

 SAP?

Hi Amrit,

do I get it right – you have the data of a study ready and no software to evaluate it? What does your protocol say?

Dif-tor heh smusma 🖖🏼 Довге життя Україна! [image]
Helmut Schütz
[image]

The quality of responses received is directly proportional to the quality of the question asked. 🚮
Science Quotes
SDavis
★★  
Homepage
UK,
2019-12-18 17:52
(1561 d 17:58 ago)

@ amritp49
Posting: # 20998
Views: 4,651
 

 Tmax Hypothesis testing

Hi Amrit,
As Helmut indicated it would be greatly preferred to have defined your Statistical Analysis Plan before acquiring your data.

If you don't have the software /expertise in house already then of course you can pay a consultant to analyse it for you (and advise you for future studies). There are many of these consultants on this forum already and I imagine you can direct message them if you need their services. If you wish for Certara to perform the analysis for you; we also have a consulting group you can contact. IF you can't find it on the website then feel free to PM me.

Simon.

Simon
Senior Scientific Trainer, Certara™
[link=https://www.youtube.com/watch?v=xX-yCO5Rzag[/link]
https://www.certarauniversity.com/dashboard
https://support.certara.com/forums/
0521
☆    

China,
2019-12-18 17:55
(1561 d 17:55 ago)

@ amritp49
Posting: # 20999
Views: 4,577
 

 Tmax Hypothesis testing

❝ I was looking for winnonlin software. I mean we have some data to analyze in winnonlin software. so if we can send our data to analyze on payment basis.


You can ask your local CRO company for help.
I don't think forum administrators are allowed to talk about business here.


Edit: Full quote removed. Please delete everything from the text of the original poster which is not necessary in understanding your answer; see also this post #5[Mittyri]
UA Flag
Activity
 Admin contact
22,957 posts in 4,819 threads, 1,639 registered users;
79 visitors (1 registered, 78 guests [including 4 identified bots]).
Forum time: 11:51 CET (Europe/Vienna)

Nothing shows a lack of mathematical education more
than an overly precise calculation.    Carl Friedrich Gauß

The Bioequivalence and Bioavailability Forum is hosted by
BEBAC Ing. Helmut Schütz
HTML5