This Article Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Ratain, M. J. Search for Related Content PubMed PubMed Citation Articles by Ratain, M. J.

Phase II Oncology Trials: Let's Be Positive

Author's Affiliation: Section of Hematology/Oncology, Department of Medicine, Committees on Clinical Pharmacology and Pharmacogenomics and Molecular Medicine, and Cancer Research Center, University of Chicago, Chicago, Illinois

Requests for reprints: Mark J. Ratain, Department of Medicine, University of Chicago, MC2115, 5841 South Maryland Street, Chicago, IL 60637. Phone: 773-702-4400; Fax: 773-702-3969; E-mail: mratain{at}medicine.bsd.uchicago.edu.

The critical decision in drug development is often at the end of phase II, as phase III trials are an expensive undertaking, with the potential for significant corporate and public consequences in the event of a negative phase III trial. Thus, retrospective analyses of the usefulness of phase II trials are welcomed and valued, as illustrated by the study of Goffin et al. (1). In this analysis of 58 cytotoxic drugs, 46 studied in phase II, the authors show a statistical relationship between objective response rate and probability of approval of the drug, with the important exception of responses in metastatic melanoma and renal cell carcinoma.

Most readers will not be surprised by the authors' findings of a relationship between phase II response rate and subsequent marketing of the drug. A drug may show activity in a specific disease in phase I or II, however, but may not be developed further in that disease because of business concerns. Thus, one would expect a bias towards phase III trials in diseases with larger markets, generally considered to be breast, colorectal, lung, and prostate cancers. Therefore, a lower approval rate in melanoma and renal cell cancer could potentially be affected by a lower number of phase III trials in these indications with smaller markets. In fact, Goffin et al. (1) did not address whether or not phase III trials were conducted with those agents that had phase II response rates of 10% or more. One cannot firmly conclude, therefore, that the phase II results were not predictive for phase III results in melanoma and renal cell cancer, as opposed to an alternative explanation that there was relatively little interest in seeking approval for these indications. What have we learned from this analysis? It is important to emphasize that a correlation, albeit significant, does not necessarily result in usefulness. A more important issue is the usefulness of phase II oncology trials, particularly in the context of predicting marketing approval for the indication studied in the specific phase II trial. To address this question, the data of Goffin et al. (1) have been reanalyzed using standard approaches to studying diagnostic tests. In this context, one normally uses metrics such as sensitivity, specificity, and predictive value (2). To assess this, one can consider various objective response rate cutoffs, as illustrated in Table 1, such as cutoffs of 10% and 20%. Sensitivity, or true positive rate, is defined as the percentage of drugs approved for an indication for which the phase II trial exceeded the threshold response rate. (It should be noted that if no drugs were approved for an indication, it is not possible to calculate the sensitivity). Specificity, or true negative rate, is defined as the percentage of drugs not approved for an indication for which the phase II trial did not exceed the threshold response rate. Positive predictive value is the likelihood of approval (for a disease) given a positive phase II trial (i.e., exceeding threshold response rate). Negative predictive value is the likelihood of not being approved for a disease (regardless of whether a phase III trial was conducted) given a negative phase II trial (i.e., not exceeding threshold response rate).

Is response rate the right end point for phase II oncology trials? This paradigm has recently been questioned in the context of the development of noncytotoxic agents (3). The data of Goffin et al. suggest that we should consider rejecting our current paradigm for cytotoxic agents as well, particularly if the goal of phase II studies is to predict for phase III success. Oncology has been recently singled out as a therapeutic area for which positive phase II trials have not been predictive of phase III success (4). As noted in Table 1, the best positive predictive value was for non–small-cell lung cancer, in which 75% of agents whose phase II response rate exceeded 20% were subsequently approved. Unfortunately, this threshold would have excluded two of our currently approved cytotoxic agents for non–small-cell lung cancer as only three of the five approved agents in this study met this criterion.

Moving forward, it is critical to consider the purpose of phase II trials. In essentially all other therapeutic areas, such studies are usually randomized, dose-ranging controlled trials, often including a placebo group, but enable determination of the relationship between dose and an end point of clinical interest, and, by extension, provide evidence of activity (5). Most importantly, phase III trials are expected to confirm findings of phase II studies, and, outside of oncology, are generally positive; consequently, phase II trials in other therapeutic areas have a high positive predictive value (4, 6). In contrast, oncology trials have a high negative predictive value but a relatively low positive predictive value (Table 1). These features may be due to the nature of cancer and anticancer agents. On the other hand, these may be due to the differences in the designs used for phase II trials in oncology, in which the classic designs are formally aimed at proving that the drug does not have activity (7). In fact, a trial that is not negative is not necessarily "positive," as borne out by the low positive predictive value for marketing approval, presumably due in a large part to the low phase III success rate.

In addition, classic phase II designs may not identify a highly active agent, as exemplified by the recent studies of sorafenib. A randomized discontinuation trial of this kinase inhibitor was conducted in 202 patients with metastatic renal cell cancer (8). Although the objective response rate (by independent review) was only 4%, there was an obvious and highly significant difference in failure-free survival after randomization, which was confirmed in a phase III trial of 800 patients (9). If this drug had been developed using classic criteria, it may never have entered phase III for this indication, given its low response rate.

The solution for moving forward is to design trials for success, not for failure. This requires abandonment of current oncology paradigms for early clinical trials and adoption of generally accepted principles of drug development. These principles have been promulgated by the Food and Drug Administration (10) and the U.S. Code of Federal Regulations Title 21 Section 312.21 (11), which states, "Phase 2 includes the controlled clinical studies conducted to evaluate the effectiveness of the drug for a particular indication or indications in patients with the disease or condition under study and to determine the common short-term side effects and risks associated with the drug. Phase 2 studies are typically well controlled, closely monitored, and conducted in a relatively small number of patients, usually involving no more than several hundred subjects." Implementation of such new paradigms will require greater attention to trial design issues in both phase I and II, but with the overriding principle that will require larger trials to prove activity. Such change will hopefully lead to a higher success rate in phase III, thereby allowing a more rapid translation of scientific advances into cost-effective therapy for cancer patients.

Received 5/11/05; accepted 5/25/05.

	References

Top References

 

1. Goffin J, Baral S, Dongsheng T, Nomikos D, Seymour L. Objective responses in patients with malignant melanoma or renal cell cancer in early clinical studies do not predict for regulatory approval. Clin Cancer Res 2005;11:5928–34.[Abstract/Free Full Text]
2. Chu K. An introduction to sensitivity, specificity, predictive values and likelihood ratios [review]. Emerg Med 1999;11:175–81.
3. Ratain MJ, Eckhardt SG. Phase II studies of modern drugs directed against new targets: if you are fazed, too, then resist RECIST. J Clin Oncol 2004;22:4442–5.[Free Full Text]
4. Booth B, Glassman R, Ma P. Oncology's trials. Nat Rev Drug Discov 2003;2:609–10.[CrossRef][Medline]
5. Shen L. An improved method of evaluating drug effect in a multiple dose clinical trial. Stat Med 2001;20:1913–29.[CrossRef][Medline]
6. Sheiner LB. Learning versus confirming in clinical drug development. Clin Pharmacol Ther 1997;61:275–91.[CrossRef][Medline]
7. Ratain MJ, Mick R, Schilsky RL, Siegler M. Statistical and ethical issues in the design and conduct of phase I and II clinical trials of new anticancer agents. J Natl Cancer Inst 1993;85:1637–43.[Free Full Text]
8. Ratain M, Eisen T, Stadler W, et al. Final findings from a phase II, placebo-controlled, randomized discontinuation trial (RDT) of sorafenib (BAY 43–9006) in patients with advanced renal cell carcinoma (RCC). Proc Am Soc Clin Oncol 2005;23:388s.
9. Onyx Pharmaceuticals [homepage on the Internet].BAY 43–9006 shown to delay disease progression in phase III study in advanced kidney cancer patients. [cited 2005 Mar 21]. Available from: http://www.onyx-pharm.com/wt/page/pr_1111376865.
10. Food and Drug Administration [homepage on the Internet]. General considerations for the clinical evaluation of drugs. [issued 1978]. Available from: www.fda.gov/cder/guidance/old034fn.pdf.
11. US Government Printing Office-NARA[homepage on the Internet]. Food and Drug Administration, Dept. of Healthy and Human Services, Code of Federal Regulations. Investigational new drug application. Vol. 21, pp. 54, 2003. Available from: http://www.access.gpo.gov/cgi-bin/cfrassemble.cgi?title=200021.

This article has been cited by other articles:

				S. Kopetz, M. Overman, D. Z. Chang, K. Y. Glover, I. Shureiqi, R. A. Wolff, J. L. Abbruzzese, and C. Eng Systematic Survey of Therapeutic Trials for Metastatic Colorectal Cancer: Room for Improvement in the Critical Pathway J. Clin. Oncol., April 20, 2008; 26(12): 2000 - 2005. [Abstract] [Full Text] [PDF]

				R. H. El-Maraghi and E. A. Eisenhauer Review of Phase II Trial Designs Used in Studies of Molecular Targeted Agents: Outcomes and Predictors of Success in Phase III J. Clin. Oncol., March 10, 2008; 26(8): 1346 - 1354. [Abstract] [Full Text] [PDF]

				C. Suzuki, H. Jacobsson, T. Hatschek, M. R. Torkzad, K. Boden, Y. Eriksson-Alm, E. Berg, H. Fujii, A. Kubo, and L. Blomqvist Radiologic Measurements of Tumor Response to Treatment: Practical Approaches and Limitations RadioGraphics, March 1, 2008; 28(2): 329 - 344. [Abstract] [Full Text] [PDF]

				M. J. Ratain and R. H. Glassman Biomarkers in Phase I Oncology Trials: Signal, Noise, or Expensive Distraction? Clin. Cancer Res., November 15, 2007; 13(22): 6545 - 6548. [Full Text] [PDF]

				T. G. Karrison, M. L. Maitland, W. M. Stadler, and M. J. Ratain Design of Phase II Cancer Trials Using a Continuous Endpoint of Change in Tumor Size: Application to a Study of Sorafenib and Erlotinib in Non Small-Cell Lung Cancer J Natl Cancer Inst, October 3, 2007; 99(19): 1455 - 1461. [Abstract] [Full Text] [PDF]

				L. C. Michaelis and M. J. Ratain Phase II Trials Published in 2002: A Cross-Specialty Comparison Showing Significant Design Differences between Oncology Trials and Other Medical Specialties Clin. Cancer Res., April 15, 2007; 13(8): 2400 - 2405. [Abstract] [Full Text] [PDF]

				M. J. Ratain and T. G. Karrison Testing the Wrong Hypothesis in Phase II Oncology Trials: There Is a Better Alternative Clin. Cancer Res., February 1, 2007; 13(3): 781 - 782. [Full Text] [PDF]

				W. A. Weber and R. Figlin Monitoring Cancer Treatment with PET/CT: Does It Make a Difference? J. Nucl. Med., January 1, 2007; 48(1_suppl): 36S - 44S. [Abstract] [Full Text] [PDF]

				M. J. Ratain In Reply J. Clin. Oncol., October 1, 2006; 24(28): 4670 - 4671. [Full Text] [PDF]

This Article Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Ratain, M. J. Search for Related Content PubMed PubMed Citation Articles by Ratain, M. J.