
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Imaging, Diagnosis, Prognosis |
Authors' Affiliations: 1 Translational Outcomes Research Laboratory, 2 Women's Health Initiative Clinical Coordinating Center, 3 Cancer Prevention Program at the Fred Hutchinson Cancer Research Center, Public Health Sciences, and 4 Harborview Medical Center, University of Washington, Seattle, Washington
Requests for reprints: Nathalie Scholler, Public Health Sciences/Translational Outcomes Research Laboratory, Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, Mailstop M5-A864, P.O. Box 19024, Seattle, WA 98109-1024. Phone: 206-667-3170; Fax: 206-667-2537; E-mail: nscholle{at}fhcrc.org.
| Abstract |
|---|
|
|
|---|
Experimental Design: Four pairs of commercially available anti-CA125 antibodies and one pair of anti-HE4 antibodies were evaluated for accuracy in measuring known concentrations of antigen on a bead-based platform. The two best pairs were further assessed for reproducibility, validity, and the ability to discriminate between blinded serum samples obtained from ovarian cancer cases (n = 66) and women without ovarian cancer (n = 125).
Results: Suitability for use in a bead-based assay varied across CA125 antibody pairs. Two CA125 bead-based assays were highly reproducible (overall correlations between replicates
0.95; coefficients of variation < 0.2) and strongly correlated with the research standard CA125II RIA (correlations
0.9). Their ability to distinguish ovarian cancer cases from non-cases based on receiver operating characteristic analyses (area under the curve, AUC, of 0.85 and 0.84) was close to that of the CA125II RIA (AUC, 0.87). The HE4 bead-based assay showed lower reproducibility but yielded an AUC of 0.89 in receiver operating characteristics analysis. Multiplexing was not possible but a composite marker including CA125 and HE4 achieved an AUC of 0.91.
Conclusion: Optimization procedures yielded two bead-based assays for CA125 that perform comparably to the standard CA125II RIA, which could be combined with an HE4 bead-based assay to improve diagnostic performance, and requires only 15 µL of sample each.
The lead time of a marker is critical, as it measures the marker's ability to identify disease early in the disease process. Repositories developed by the Carotene and Retinol Efficacy Trial (19), the Women's Health Initiative (20), and the Prostate, Lung, Colon, and Ovary Cancer Screening Trial (21) have preclinical samples for a relatively large number of cases for whom blood samples were collected well in advance of diagnosis, making it possible to estimate the lead time of candidate serum biomarkers. Because of the value and scarcity of these resources, however, use of these specimens must be well-justified and optimized. The research standard, CA125 RIA CA125II, from Fujirebio Diagnostics, Inc. (FDI, Malvern, PA) requires 0.2 mL of serum sample, limiting the number of other candidates that can be evaluated simultaneously in a typical research sample of 0.5 mL. Some clinical assays require less specimen, but they yield results that vary by type, manufacturer, and generation (22). Our goal was to develop a cost-effective research-quality assay for CA125 that would require only a few microliters of serum and enable us to explore the potential for multiplexing and/or combining CA125 with novel markers such as human epididymis protein 4 (HE4; refs. 23, 24) for use in a CM and a longitudinal algorithm.
Bead-based ELISA assays require relatively small volumes of sample material (25, 26). The technology derives from sandwich ELISA assays but uses spectrally discrete polystyrene beads, or microspheres, instead of plastic surfaces to immobilize the capture antibody. Bio-Rad Laboratories, Inc. (Hercules, CA) commercializes carboxy-coated microspheres internally labeled with two fluorescent dyes that produce up to 100 different spectral addresses, and a Multiplex Suspension Array System (Luminex 110S system) whose reading system (Bio-Plex reader) functions on the same principles as a flow cytometer. Similar to a sandwich ELISA assay, each antibody-coupled microsphere captures antigens that are detected with a biotinylated antibody and phycoerythrin-conjugated streptavidin (SA-PE). For each capture antibodycoupled microsphere, the Bio-Plex reader simultaneously measures the fluorescent signals of the microsphere's particular spectral address and of the SA-PE. Each mean fluorescence intensity (MFI) reading corresponds to the average of the fluorescent signals from 100 antibody-coupled microspheres of a particular spectral address; duplicate measurements are not required. In the absence of cross-reactivity, each reading can assess the concentration of multiple markers that are detected by spectrally distinct beads, further diminishing the sample volume needed.
We developed CA125 bead-based assays using commercially available antibodies directed against the M11-like or the OC125-like epitopes, and an HE4 bead-based assay using the only available antibody pair for HE4 (13, 24). Evaluation of the candidate bead-based assays was based on several objectives and criteria. First, laboratory analyses were done to assess the antibody binding to the beads, the antigen affinity of the capture antibody after immobilization on the beads, and the antibody performance as a sandwich pair against known concentrations of antigen using purified antigen and selected sera. The top two performing CA125 antibody pairs in the bead-based assays were then evaluated for multiplexing with HE4, and the best assays were evaluated in patient sera for their reproducibility, validity, and performance relative to the standard CA125II RIA. As the ultimate objective is to be able to identify ovarian cancer cases early, the bead-based assays were also evaluated for their temporal stability in serial blood samples (27). Screening decisions based on CA125 most commonly use a single-threshold screening rule that prompts referral for follow up when CA125 values are found above the reference range, but performance can be improved by use of a longitudinal algorithm when a marker is stable over time in women (28).
| Materials and Methods |
|---|
|
|
|---|
In the second phase of the work, the two best pairs of CA125 antibodies and the HE4 antibody pair were analyzed in blinded patient sera. To assess reproducibility for each of the three antibody pairs, pooled negative serum and CA125/HE4-positive serum were measured repeatedly over 10 days. Serum replicates were used to estimate coefficients of variation (CV). In addition, 204 patient samples from 191 women with and without ovarian cancer were assayed twice over the same 10 days; reproducibility was assessed by the correlation between the two experiments. Results from the first experiment for each CA125 and HE4 antibody pair were also used to correlate the findings to the standard CA125II RIA or HE4 ELISA and to generate receiver operating characteristic (ROC) curves assessing diagnostic accuracy.
Mouse mAbs. Anti-CA125 mAb were acquired from Fujirebio Diagnostics (OC-125 and M11), Fitzgerald Industries International, Inc. (FIII, Concord, MA; M8072320 and M8072321, and M002201 and M002203), and Research Diagnostics, Inc. (RDI, Flanders, NJ; X306 and X52). M8072320, M002201 and X306 epitopes are OC-125-like, whereas M8072321, M002203, and X52 are M11-like. Manufacturers recommend using M11, X306, and M002201 as capture antibodies. For the HE4 assay and to test multiplexing, one complementary pair of anti-HE4 mAbs (3D8 and 2H5) were used (24). Antibodies were dialyzed against Dulbecco's PBS (Invitrogen Corporation, Carlsbad, CA) when needed. Carboxy-coated microspheres (Bio-Rad Laboratories) were coupled with five concentrations (0.2, 1, 5, 10, and 20 µg/mL) of the capture antibodies or with both antibodies of the same pair if no recommendation was given (FIII M8072320 and M8072321). Detection antibodies were biotinylated using the EZ-Link-sulfo-NHS-biotinylation kit (Pierce, Rockford, IL) according to the manufacturer's instructions and dialyzed against PBS (Pierce Slide-a-Lyzer, 7 kDa molecular weight cutoff).
Study population and serum sample collection. Study participants were recruited between 1999 and 2003 to support protocols of the Pacific Ovarian Cancer Research Consortium by physicians at Pacific Gynecology Specialists, Swedish Medical Center, the University of Washington/Seattle Cancer Care Alliance, and Virginia Mason Medical Center. Cases (n = 66) were defined as having invasive epithelial carcinoma confirmed by standardized review of medical records and pathologist examination of paraffin-embedded tissue; histologies represented clinical practice and included 33 serous, 7 endometrioid, 3 mucinous, 3 clear cell, 6 undifferentiated, and 14 other. International Federation of Gynecology and Obstetrics stage distribution similarly reflected clinical practice, including 11 stage I, 5 stage II, 37 stage III, 11 stage IV tumors, and 2 unknown stages. Non-cases, representing women free of ovarian cancer (n = 125), consisted of surgical patients (n = 72) and women (n = 53) enrolled in screening trials who were free of ovarian cancer two or more years after serum collection. Thirteen of the screening trial participants provided serial blood samples collected 1 year apart, yielding 66 blood samples for analysis from the screening population. Participants' characteristics are reported in Table 1 . In addition, a pool of sera from nine healthy postmenopausal women collected in a volunteer blood drive was used as negative control. Each patient provided written informed consent and a medical records release form approved by the Fred Hutchinson Cancer Research Center Institutional Review Board.
|
CA125 and HE4 bead-based immunoassays. Development and evaluation of the bead-based assays were done in filter plates (Millipore Corporation, Billerica, MA). A vacuum manifold (Millipore) was used to drain reagents and wash steps. All incubations were done at room temperature, in the dark, and on a plate shaker. Carboxy-coated microspheres (Bio-Rad Laboratories) were resuspended at each step by ramping the plate shaker to a speed of 1,000 rpm, then reducing to 300 rpm for the incubation. Filter plates were pre-wet with assay buffer prior to adding the microspheres. Capture antibodies were covalently coupled to the microspheres using the Amine Coupling Kit (Bio-Rad Laboratories) according to the manufacturer's instructions. Briefly, microsphere stock solutions were dispersed by vortexing and water bath sonication (Branson ultrasonic cleaner, Danbury, CT), and then checked visually for aggregation. For each coupling, a 100-µL aliquot of 1.25 x 106 monodispersed microspheres was transferred to a coupling reaction tube provided in the kit. The microspheres were washed with the kit bead wash buffer, resuspended in 80 µL of the kit bead activation buffer, vortexed, and sonicated. Freshly made solutions of 10 µL of 50 mg/mL 1-ethyl-3-(3-dimethylaminopropyl)-carbodiimide hydrochloride (Pierce) and N-hydroxy-sulfosuccinimide (Sulfo-NHS, Pierce) were added sequentially to the coupling tubes to stabilize the reaction and activate the microspheres. After vortexing, the microspheres were incubated (rotating) for 20 minutes, and then washed and resuspended. Various dilutions of capture antibodies were added, the volumes adjusted to 500 µL and the coupling reaction was incubated for 2 hours. After one wash, the coupled microspheres were blocked with the kit's blocking buffer for 30 minutes. Finally, microspheres were resuspended in storage buffer, counted using a hemocytometer and stored at 4°C. To test the coupling efficiency, 5,000 microspheres were incubated for 30 minutes with 2 µg/mL of biotinylated goat anti-mouse IgG H + L (Invitrogen) followed by three washes and a 10-minute incubation with SA-PE. Labeled microspheres were washed thrice, resuspended in 125 µL of assay buffer, and analyzed with the Bio-Plex reader. MFI of at least 2,000 was considered an efficient coupling. Our criterion to identify the best pairs of antibodies in the first phase of the work was the greatest ratio between the MFIs measuring between 0.1 and 1,000 units/mL of CA125. HE4-Ig fusion recombinant protein was assayed in the same samples on the same plates, independently, and multiplexed with each of the CA125 bead-based assays. Criterion for acceptable multiplexing was MFI consistency in the absence and in the presence of reagents for another bead-based assay. All assays of patient samples were run using the same lots of coupled microspheres and biotin-conjugated detection antibodies.
Statistical analyses. All analyses were done in S-Plus version 6.2 (Insightful, Seattle, WA). Assay reproducibility for the two CA125 bead-based assays and the HE4 assay was assessed by calculating the CV among control replicates and estimating Pearson correlations between repeated experiments. Positive control serum (CA125 level, 231 units/mL as measured by CA125II RIA; HE4 level, 5 ng/mL as measured by ELISA) was measured 19 times in 10 separate experiments, providing 19 replicates for each assay. The pool of negative control serum (CA125 < 7 units/mL by RIA; HE4 undetectable by ELISA) was measured 8 times in triplicate and 11 times alone in 10 separate experiments that included one or two plates, providing 35 replicates for each assay. Among the negative and positive serum controls, an ANOVA was used to assess day-to-day variation and plate variations within days. The criteria for inclusion of data were that no errors were reported by Bio-Plex. CV's were calculated for positive and negative serum controls, on the raw scale for comparability with published estimates for standard assays. All other analyses were done after a log transformation was applied to reduce skewness in the distribution. Pearson correlations were estimated using all serum specimens for which repeated results were obtained.
Validity of the CA125 bead-based ELISAs was assessed by correlating their respective CA125 concentrations to those obtained by the standard CA125II RIA in the 204 patient serum samples. Pearson correlation coefficients were calculated overall and within each patient subgroup (cases and non-cases including surgical patients and screening participants). Agreement of the HE4 bead-based assay with traditional ELISA was similarly assessed by Pearson correlation using only the 106 serum samples for which HE4 ELISA results were available (24). When a sample was dropped due to errors (n = 6) it was replaced by its replicate for validity and performance evaluations.
In terms of the diagnostic accuracy of the assays, performance was assessed by estimation of ROC curves for cases versus all non-cases, cases versus surgical controls, and cases versus healthy screening controls in 64 cases and 125 non-cases (55 screening controls and 70 surgical controls) who reported no history of ovarian cancer and for whom all four assay measurements were available, including the three bead-based assays (two CA125 and one HE4 assay) and the CA125II RIA. The ROC curves jointly describe the sensitivity and specificity of the assay as the threshold for a positive test is allowed to vary. The area under the curve (AUC; ref. 29) is reported, where 1.0 represents perfect performance and 0.5 represents what one would expect of chance alone. The equality of the AUC's was tested using a nonparametric method developed by DeLong et al. (30). ROC curves for individual bead-based assays were compared with those for the standard CA125II RIA. In addition, two CMs were constructed by combining each of the CA125 bead-based assays with the HE4 bead-based assay using main effects obtained by logistic regression (31); the AUC for each CM was compared with that of CA125II RIA.
To evaluate the stability over time of the markers using bead-based assays, the correlation between two measures made in serum samples collected 1 year apart are reported for each bead-based assay and for the standard CA125II RIA. The temporal stability of a marker is critical for the exploitation of a longitudinal algorithm in a screening program (28).
| Results |
|---|
|
|
|---|
1 µg/mL; data not shown). Based on a criterion of greatest ratio between the MFIs measuring 0.1 and 1,000 units/mL of CA125 purified antigen, we eliminated the FIII pair with clone M8072321 as capture antibody (orientation 2, Fig. 1D). Beads coupled with capture antibody concentrations that discriminated best between various antigen concentrations were selected for further tests: RDI X306, 5 µg/mL; FDI M11, 1 µg/mL; FIII M002201, 1 µg/mL; and FIII M8072320, 20 µg/mL.
|
|
The above results were used to determine the experimental conditions for the rest of the study: the FIII capture antibody M8072320 was coupled at 20 µg/mL and the RDI capture antibody X306 was coupled at 5 µg/mL, whereas the detection antibodies were used at 1 µg/mL for the FIII antibody M8072321 and at 2 µg/mL for the RDI antibody X52.
Similarly, an HE4 bead-based assay was validated with HE4-Ig fusion recombinant protein and calibrated with four positive and negative control sera characterized by sandwich ELISA test (24). As previously described, beads coupled to 2H5 anti-HE4 capture antibody were validated with biotinylated goat anti-mouse IgG (data not shown). Figure 2B shows that microspheres coupled with 10 µg/mL of 2H5 and detected with 6 µg/mL of biotinylated 3D8 discriminated best between the positive and negative control sera.
Multiplexing. Multiplexing of CA125 and HE4 bead-based assays was tested with both the FIII and RDI antibody pairs. The HE4 MFI readings were not affected by the presence of the anti-CA125 reagents (Fig. 2C). However, the MFI of both the RDI (Fig. 2D) and the FIII (data not shown) CA125 assays increased with the addition of HE4 bead-based assay components, suggesting the cross-reactivity of the anti-HE4 antibodies with the anti-CA125 antibodies. Accordingly, multiplexing was not used for analyses in blinded patient sera.
Assay reproducibility. The best CA125 antibody pairs (FIII 8072320/21 and RDI X306/X52) and the HE4 antibody pair were then evaluated in blinded serum from our study population. All the assays were done with the sera diluted 4-fold, thus, requiring only 0.015 mL of serum per assay per sample. Bead coupling reactions were highly reproducible as shown by validation results with a goat anti-mouse antibody to quantify the mouse antibody bound to the beads (MFI < 8% SD for eight couplings done over 6 months).
Reproducibility was assessed using multiple replicates of negative (n = 35) and positive (n = 19) serum controls to estimate a CV for each assay. Plate effects assessed by ANOVA included small day-to-day variations found in both sera controls for the CA125 RDI and HE4 assays, and small order effects found both in the positive controls for the CA125 FIII and HE4 assays and in the negative controls for the CA125 RDI and HE4 assays (data not shown). The average CVs for the CA125 RDI and FIII bead-based assays were, respectively, 18.2 and 15.7 for the pooled control sera, and 18.9 and 10.2 for the CA125/HE4-positive sera. The CVs for the HE4 assay were higher, ranging from 26.6 for the positive sera to 32.6 for the pool of negative sera.
For further assessment of reproducibility, blinded samples from191 patients were tested twice in independent experiments conducted identically 1 week apart. Overall, the Pearson correlations for replicates were 0.99, 0.95, and 0.95 for the RDI, FIII, and HE4 assays, respectively (Table 2 ). The estimated correlations within subgroups (i.e., cases, surgical controls, and screening controls) ranged from 0.64 (FIII screening controls) to 1.00 (RDI cases) providing strong evidence of assay reproducibility, even within the narrower range of antigen levels characteristic of healthy controls. The RDI assay yielded modestly higher correlations between replicates than the FIII assay overall and in all three subgroups. Reproducibility for the HE4 bead-based assay was similar, with correlations slightly higher in screening controls (0.86 versus 0.83 and 0.64) but lower in surgical controls (0.90 versus 0.98 and 0.97; Table 2).
|
Diagnostic accuracy. ROC curves describing the ability to distinguish cases from non-cases for each of the two CA125 assays, HE4 and the standard CA125II RIA (Fig. 3A-C ) suggest that all four assays provide comparable classification ability over the full range of specificity, even in analyses restricting the non-cases to either the surgical controls (Fig. 3B) or the screening controls (Fig. 3C). AUC statistics ranged from 0.93 for the HE4 assay in cases versus screening controls to 0.81 for the FIII assay in cases versus surgical controls, with the HE4 assay consistently providing the highest values followed by the RIA, RDI, and FIII assays in that order. Differences in AUC values for the individual markers were not statistically significant.
|
|
| Discussion |
|---|
|
|
|---|
At least two of the four commercially available antibody pairs (RDI X306/X52 and FIII M8072320/21) are suitable for the bead-based platform. Orientation of capture and detection antibodies was important, and not necessarily consistent with the manufacturer's reported results in sandwich test ELISA. Prediction programs based on three-dimensional protein structures as well as new technologies to rapidly isolate numerous antibodies against each candidate marker may be needed to fully realize the potential of the bead-based assay platform. In the absence of better tools to predict the best antibodies for bead-based assays, an empirical approach is needed to compare antibody performance.
To explore the potential for multiplexing, and use of a CM, we have also developed an HE4 bead-based assay and tested it with the two CA125 bead-based assays. The HE4 bead-based assay was robust, but the CA125 MFI increased with the addition of the HE4 bead-based assay reagents, suggesting an interaction of the anti-HE4 antibodies with the CA125 assay. Interestingly, the change was unilateral and resulted in an increase of signal that is inconsistent with competition. It might be possible that conformational changes affect the MFI reading. For example, complex formation would yield a larger protein volume, changing the distance between the detection antibody and the beads and perhaps improving the fluorescent signal spatial location for the Bio-Plex reader. Nonspecific binding of the anti-HE4 reagents to CA125, a very large glycoprotein, could produce complex formation. The interaction between CA125 and the COOH-terminal domain of mesothelin (32), another putative serum marker for ovarian cancer (33), could be an additional source of conformational changes. Alternative antibodies may be needed against markers that are to be multiplexed with CA125.
The CA125 and HE4 bead-based assays are acceptably reproducible and valid, and provide excellent diagnostic accuracy. CV's for the RDI and FIII CA125 assays were <0.2; those for the HE4 bead-based assay were
0.30. These are higher than CV's for the research standard CA125II RIA (<0.1). Plate effects were present, suggesting that CV's could be reduced by the inclusion on each plate of a standard curve, as is done in kits such as the CA125II RIA. The reproducibility of the assays, based on repeated experiments in patient sera, suggests that the RDI CA125 bead-based assay is as consistent with the CA125II RIA as the AxSYM CA125 microparticle enzyme immunoassay that is used routinely in clinical practice (r = 0.95 for both). Importantly, the CA125 bead-based assays were equivalent in their disease classification of patient samples as assessed by ROC methods. Correlations of HE4 bead-based assay results with sandwich ELISA test results were >0.9 overall, and ROC curves for the HE4 bead-based assay were higher than any of the other assays including the research standard CA125II RIA. These results contribute to a growing body of evidence that HE4 is a promising biomarker for the early detection of ovarian cancer (34).
Based on tissue arrays, HE4 has recently been reported to complement the expression of CA125 in epithelial ovarian cancer (35), but this is the first report that HE4 complements CA125 in serum as well as the first report of a bead-based assay for HE4. Because the CM was estimated using the same data that were used to generate the ROC curves, a subset of which had been used in an earlier report (24), the results reported here must be interpreted as a first report of a panel that includes HE4 and CA125 rather than as a validation study. More research is needed, particularly in preclinical samples, to confirm that HE4 complements CA125 and that a CM including both markers has better performance than CA125 alone.
We conclude from these analyses that bead-based assays can potentially perform as well as traditional sandwich ELISA tests, and specifically, that use of the RDI antibody pair to measure CA125 in preclinical samples will yield estimates that are comparable to those obtained from the research standard CA125II RIA. As the RIA kit requires at least 200 µL of serum, compared with 15 µL for the bead-based assay, the bead-based assay is preferred for its efficient use of specimen in settings where specimen volume is an important consideration. Although multiplexing would further reduce specimen requirements, it is not necessary given the low specimen requirements of individual assays in the bead-based platform and should not be used without rigorous testing to document the absence of cross-reactivity.
| Acknowledgments |
|---|
| Footnotes |
|---|
The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.
Received 9/13/05; revised 12/20/05; accepted 1/26/06.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N. Scholler, K. A. Lowe, L. A. Bergan, A. V. Kampani, V. Ng, R. M. Forrest, J. D. Thorpe, J. A. Gross, B. M. Garvik, R. Drapkin, et al. Use of Yeast-Secreted In vivo Biotinylated Recombinant Antibodies (Biobodies) in Bead-Based ELISA Clin. Cancer Res., May 1, 2008; 14(9): 2647 - 2655. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Fredriksson, J. Horecka, O. Terje Brustugun, J. Schlingemann, A. C. Koong, R. Tibshirani, and R. W. Davis Multiplexed Proximity Ligation Assays to Profile Putative Plasma Biomarkers Relevant to Pancreatic and Ovarian Cancer Clin. Chem., March 1, 2008; 54(3): 582 - 589. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Cell Growth & Differentiation |