
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Perspective |
Biometric Research Branch, National Cancer Institute, Bethesda, Maryland
| ABSTRACT |
|---|
|
|
|---|
Experimental Design: We evaluated the relative efficiency of a targeted clinical trial design to an untargeted design for a randomized clinical trial comparing a new treatment to a control. Efficiency was evaluated with regard to number of patients required for randomization and number required for screening.
Results: The effectiveness of this design, relative to the more traditional design with broader eligibility, depends on multiple factors, including the proportion of responsive patients, the accuracy of the assay for predicting responsiveness, and the degree to which the mechanism of action of the drug is understood. Explicit formulas were derived for computing the relative efficiency of targeted versus untargeted designs.
Conclusions: Targeted clinical trials can dramatically reduce the number of patients required for study in cases where the mechanism of action of the drug is understood and an accurate assay for responsiveness is available.
| INTRODUCTION |
|---|
|
|
|---|
We compared the two designs with regard to the number of randomized patients required. We also compared the number of randomized patients for the untargeted design to the number of screened patients required for the targeted design. We assume that in the targeted design patients are screened using an assay that indicates whether the patient is likely to benefit from the new treatment. If the control arm is an active treatment, then the screening classifier should provide an indication of whether the patient is more likely to respond to the new regimen than to the control arm. Our efficiency comparisons are based on using the formula of Ury and Fleiss (6) for planning sample size for comparing proportions because of its known accuracy for approximating the tables of Casagrande, Pike, and Smith for the power of Fishers exact test (7) .
| MATERIALS AND METHODS |
|---|
|
|
|---|
of the population. Patients were randomized between the control and the experimental groups. pc denotes the response probability in control group and was assumed to be the same for R and R+ patients. The response probability in the treatment group was pc +
0 and pc +
1 for the R and R+ patients, respectively. The response probability pe for the experimental treatment group in the untargeted design was a weighted average of pc +
0 and pc +
1 with weights
and 1-
, respectively.
For the targeted design we added the symbol T. The response probability in the experimental group was peT = pc +
1. We consider the one-sided test of the null hypothesis pc = pe against the alternative hypothesis pe > pc.
Let n and nT denote the number of patients needed to randomize in the untargeted and targeted design respectively to achieve the same statistical power for testing the null hypothesis. The expressions for n and nT are indicated in the Appendix. The relative efficiency of the untargeted and the targeted designs can be expressed in the form:
![]() |
We considered cases where the R- patients do not benefit from the new treatment (
0 = 0: case 0) and cases where they benefit half as much as the R+ patients (
0 =
1/2: case 1). The response probabilities for control group pc were taken equal to 0.1 or 0.5, and the improvement in response probability for the R+ patients (
1) was 0.2 or 0.4. The calculations shown below were done with
= 0.025 and power 80% (ß = 0.2).
| RESULTS |
|---|
|
|
|---|
|
0 = 0 in equation A
. This gives:
![]() |
= 0.5, equation B gives a relative efficiency of 4f. When pc is not close to 0, the value of f is close to 1 (see Supplementary Data), and the untargeted design requires about four times as many randomized patients. When pc is close to 0, the factor f is <1, and the relative efficiency is <4.
Although the advantage of the targeted design was not as great when the experimental treatment was somewhat effective for both groups of patients (case 1), the reduction in required number of patients can still be substantial. For case 1 with
0 =
1/2, the relative efficiency formula (A)
reduces to:
![]() |
= 0.5, the relative efficiency is (4/3)2f, which is
1.75 when f is close to 1. Hence, the untargeted design requires
75% more randomized patients in this scenario.
If we assume that only R+ patients benefit from the new treatment but that selection of patients is determined by an imperfect assay, then the treatment benefit for assay negative patients can be shown to be
1(1 NPV) where NPV denotes the negative predictive value of the assay; that is, the probability that the true status is R when the assay is negative (see Supplementary Data). The treatment benefit for assay positive patients is
1PPV where PPV is the positive predictive value of the assay. NPV and PPV values of at least 0.9 are highly desirable for enabling the efficiency of the targeted design to be achieved. Decreasing NPV is equivalent to increasing
0, whereas decreasing PPV is equivalent to decreasing
1.
Number of Patients Screened for Targeted Design.
To randomize nT patients with the targeted design, a greater number of patients must be screened. If nT/(1-
) patients are screened, then the expected number of randomized patients is nT because 1-
is the proportion of R+ patients. This is, of course, not required for the untargeted design. Fig. 2
shows the ratio of the number of randomized patients for the untargeted design (n) to the number of screened patients for the targeted design nT/(1-
). Again, there is a clear separation between the scenarios where R- patients do not benefit from the experimental treatment (case 0) and those scenarios where R patients benefit partially from the experimental treatment (case 1).
|
![]() |
For the scenarios of case 1 where the R patients benefit partially from the experimental treatment (Fig. 2)
, the number of patients required for screening with the targeted design is always greater than the number required to randomize for the untargeted design. Analytically the ratio is:
![]() |
= 0.5 and f = 1, this ratio equals 16/18.
Examples.
Trastuzumab is a monoclonal antibody against the Her2 receptor, which is overexpressed in 25% to 30% of breast cancers (8)
. A targeted randomized Phase III trial of standard chemotherapy with or without Trastuzumab was conducted in 469 patients with metastatic breast cancer whose tumors overexpressed Her2 based on immunohistochemical analysis in a central laboratory. The results were highly statistically significant favoring the Trastuzumab arm with regard to several end points including 1-year survival rate (78% versus 67%). If we assume that the antibody is completely ineffective in assay negative patients (
0 = 0) then equation B indicates that the ratio of number of randomized patients for untargeted versus targeted trial is
16 to 1 (1-
= 0.25, f = 1). A targeted trial of the size actually conducted provides 90% power for detecting a 9.6% improvement in the 1-year survival rate above a baseline of 67% with a two-sided 5% statistical significance level (pc = 0.67,
1 = 0.096). If the trial were untargeted then the formula for n in the Appendix with pc = 0.67,
0 = 0,
1 = 0.096, 1-
= 0.25, and pe = pc+
0+(1-
)
1 indicates that 23,586 randomized patients would be required, because the overall treatment improvement in 1-year survival rate would be only 2.4%. If assay-negative patients also benefit from Trastuzumab, then the sample size for the untargeted trial would be reduced. For example, suppose the assay-negative patients benefit half as much as the assay-positive patients (
0 = 0.048 and consequently pe = 0.67 + 0.06). Then the overall treatment benefit for the untargeted trial is a 6% improvement in 1-year survival rate, and the untargeted trial requires only 1,256 total patients. This is still 2.67 times as many randomized patients as required for the targeted trial. Also, although immunohistochemical assays are not precise, it seems unlikely that the assay-negative patients would achieve half the benefit as the assay positive patients.
Gefitinib is a small molecule inhibitor of epidermal growth factor receptor (EGFR) kinase activity. Two untargeted Phase III trials of standard chemotherapy with or without gefitinib in 2,130 chemotherapy naïve patients with advanced non-small cell lung cancer failed to demonstrate any benefit of gefitinib (9
, 10)
. Two reports indicated recently that response to gefitinib alone in patients treated previously can be predicted on the basis of somatic mutations in the tyrosine kinase domain of the EGFR gene (11
, 12)
. In the report by Lynch et al. (11)
, 8 of 9 responders had such mutations compared with none of seven nonresponders. Only
10% of non-small cell lung cancer patients have tumors with such mutations. Conducting an untargeted Phase III trial for a molecularly targeted drug with a 1-
value of only 10% is almost a futile proposition, as noted by Dancey and Freidlin (13)
if R patients do not benefit. Even the 2,130 patients actually randomized is insufficient. For example, even if the 1-year survival rate is increased by an enormous 40% over the baseline level of 40% (
1 = 0.40, pc = 0.40) for patients whose tumors have the mutation, then the formula of the Appendix with
0 = 0 and 1-
= 0.10 indicates that for 90% power and a 2-sided 5% significance level a nontargeted trial requires 3,248 randomized patients. If the size of the treatment benefit for patients with mutations is a more realistic 20% increase in 1-year survival rate, then the nontargeted design requires 12,806 patients. The formula in the Appendix for nT indicates that the targeted design requires only 34 and 138 total randomized patients, respectively, in these two conditions. For gefitinib, the assumption
0 = 0 seems reasonable based on the available data and on the accuracy of a genotype assay. At the time the Phase III trials were initiated, an accurate assay for predicting gefitinib activity was not available. Overexpression of EGFR did not correlate well with gefitinib response, and the relationship between mutations in the tyrosine kinase domain of the EGFR gene and response to gefitinib was not known. The relationship was discovered, however, based on materials collected in the Phase II trials. The Phase II response rates suggested that the proportion of patients responsive to gefitinib was very small, and consequently it may have been beneficial to attempt to characterize Phase II responders based on genotype or gene expression profile data before launching the Phase III trials.
| DISCUSSION |
|---|
|
|
|---|
When the experimental treatment has multiple pathways of effect or when the negative predictive value of the assay is inadequate, then the advantages of the targeted design are more limited. The targeted design may still require fewer randomized patients, and an estimate of its efficiency can be obtained from Fig. 1
or using equation C
. Under these conditions, however, the targeted design may require more patients to be screened. The increment in the number of screened patients can be estimated from Fig. 2, A and B
, or from equation E
. Unless there are substantial savings in the required number of randomized patients, the targeted design may not be deemed worthwhile because of the need to screen patients and the potential restriction in applicability of the experimental treatment. When the experimental treatment is partially effective for the R patients and the proportion of R+ patients is very low, both targeted and untargeted designs become very expensive. The untargeted design becomes expensive because a huge number of randomized patients is required, because the average treatment effect for all of the randomized patients becomes very small. The targeted design becomes expensive, because a large number of patients must be screened.
Several aspects of the model used here are idealizations. One limitation is our use of a binary outcome end point. Although many cancer clinical trials are based on survival or disease-free survival end points, the use of binary outcome here enables us to avoid technical complexities, which might mask the most essential issues. Our results highlight the potential value of codevelopment with a therapeutic of an accurate assay for predicting responsive patients and the value of understanding the mechanisms of action of new therapeutics so that its potential realm of effectiveness can be efficiently established. Our evaluation presupposes the existence of Phase II data in unselected populations that enables the development or validation of an assay for identifying patients who are most likely to respond to the treatment. The development of predictively accurate assays is difficult, and limitations in the assay will decrease the potential efficiency gains that can be achieved from a targeted Phase III trial.
The Ury and Fleiss expression for the sample size of the untargeted design is:
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
and zß denote the 100 (1-
) and 100 (1-ß) percentiles of the standard normal distribution.
For the targeted design we add the symbol T. The response probability in the experimental group is peT = pc +
1 and the expression for the sample size becomes:
![]() |
![]() |
![]() |
![]() |
![]() |
| FOOTNOTES |
|---|
Note: Supplementary data for this article may be found at http://linus.nci.nih.gov/
brb/TechReport.htm.
Requests for reprints: Richard Simon, National Cancer Institute, 9000 Rockville Pike, Bethesda MD 20892-7434. Phone: 301-496-0975; Fax: 301-402-0560; E-mail: rsimon{at}nih.gov
Received 3/11/04; revised 5/14/04; accepted 5/19/04.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Bergh Quo Vadis With Targeted Drugs in the 21st Century? J. Clin. Oncol., January 1, 2009; 27(1): 2 - 5. [Full Text] [PDF] |
||||
![]() |
S. L. George Statistical Issues in Translational Cancer Research Clin. Cancer Res., October 1, 2008; 14(19): 5954 - 5958. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Chang, K. R. Lamborn, J. G. Kuhn, W.K. A. Yung, M. R. Gilbert, P. Y. Wen, H. A. Fine, M. P. Mehta, L. M. DeAngelis, F. S. Lieberman, et al. Neurooncology clinical trial design for targeted therapies: Lessons learned from the North American Brain Tumor Consortium Neuro-oncol, August 1, 2008; 10(4): 631 - 642. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Hoering, M. LeBlanc, and J. J. Crowley Randomized Phase III Clinical Trial Designs for Targeted Agents Clin. Cancer Res., July 15, 2008; 14(14): 4358 - 4367. [Abstract] [Full Text] [PDF] |
||||
![]() |
Xian Zhou, Suyu Liu, E. S Kim, R. S Herbst, and J J. Lee Bayesian adaptive design for targeted therapy development in lung cancer -- a step toward personalized medicine Clinical Trials, June 1, 2008; 5(3): 181 - 193. [Abstract] [PDF] |
||||
![]() |
D. J. Sargent and D. F. Hayes Assessing the Measure of a New Drug: Is Survival the Only Thing That Matters? J. Clin. Oncol., April 20, 2008; 26(12): 1922 - 1923. [Full Text] [PDF] |
||||
![]() |
W. Jiang, B. Freidlin, and R. Simon Biomarker-Adaptive Threshold Design: A Procedure for Evaluating Treatment With Possible Biomarker-Defined Subset Effect J Natl Cancer Inst, July 4, 2007; 99(13): 1036 - 1043. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. J. O'Dwyer, S. G. Eckhardt, D. G. Haller, J. Tepper, D. Ahnen, S. Hamilton, A. B. Benson III, M. Rothenberg, N. Petrelli, H.-J. Lenz, et al. Priorities in Colorectal Cancer Research: Recommendations From the Gastrointestinal Scientific Leadership Council of the Coalition of Cancer Cooperative Groups J. Clin. Oncol., June 1, 2007; 25(16): 2313 - 2321. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Yancovitz, J. Yoon, M. Mikhail, W. Gai, R. L. Shapiro, R. S. Berman, A. C. Pavlick, P. B. Chapman, I. Osman, and D. Polsky Detection of Mutant BRAF Alleles in the Plasma of Patients with Metastatic Melanoma J. Mol. Diagn., April 1, 2007; 9(2): 178 - 183. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. M. Stadler The randomized discontinuation trial: a phase II design to assess growth-inhibitory agents Mol. Cancer Ther., April 1, 2007; 6(4): 1180 - 1185. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. T. Jorgensen, K. V. Nielsen, and B. Ejlertsen Pharmacodiagnostics and Targeted Therapies--A Rational Approach for Individualizing Medical Anticancer Therapy in Breast Cancer Oncologist, April 1, 2007; 12(4): 397 - 405. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Asgharzadeh, R. Pique-Regi, R. Sposto, H. Wang, Y. Yang, H. Shimada, K. Matthay, J. Buckley, A. Ortega, and R. C. Seeger Prognostic Significance of Gene Expression Profiles of Metastatic Neuroblastomas Lacking MYCN Gene Amplification. J Natl Cancer Inst, September 6, 2006; 98(17): 1193 - 1203. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. H. Johnson Targeted therapies in combination with chemotherapy in non-small cell lung cancer. Clin. Cancer Res., July 15, 2006; 12(14): 4451s - 4457s. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Freidlin and R. Simon Adaptive Signature Design: An Adaptive Clinical Trial Design for Generating and Prospectively Testing A Gene Expression Signature for Sensitive Patients Clin. Cancer Res., November 1, 2005; 11(21): 7872 - 7878. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Walgren, M. A. Meucci, and H. L. McLeod Pharmacogenomic Discovery Approaches: Will the Real Genes Please Stand Up? J. Clin. Oncol., October 10, 2005; 23(29): 7342 - 7349. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Simon Roadmap for Developing and Validating Therapeutically Relevant Genomic Classifiers J. Clin. Oncol., October 10, 2005; 23(29): 7332 - 7341. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. J. Epstein Maintenance Therapy to Suppress Micrometastasis: The New Challenge for Adjuvant Cancer Treatment Clin. Cancer Res., August 1, 2005; 11(15): 5337 - 5341. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. J. Lee and L. Feng Randomized Phase II Designs in Cancer Clinical Trials: Current Status and Future Directions J. Clin. Oncol., July 1, 2005; 23(19): 4450 - 4457. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. F. Baker, T. Dragovich, N. T. Ihle, R. Williams, C. Fenoglio-Preiser, and G. Powis Stability of Phosphoprotein as a Biological Marker of Tumor Signaling Clin. Cancer Res., June 15, 2005; 11(12): 4338 - 4340. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Meeting Abstracts Online |