+ All Categories
Home > Documents > Performance Characteristics of a Quantitative TaqMan Hepatitis...

Performance Characteristics of a Quantitative TaqMan Hepatitis...

Date post: 15-Oct-2018
Category:
Upload: truongxuyen
View: 214 times
Download: 0 times
Share this document with a friend
8
JOURNAL OF CLINICAL MICROBIOLOGY, Aug. 2004, p. 3739–3746 Vol. 42, No. 8 0095-1137/04/$08.000 DOI: 10.1128/JCM.42.8.3739–3746.2004 Copyright © 2004, American Society for Microbiology. All Rights Reserved. Performance Characteristics of a Quantitative TaqMan Hepatitis C Virus RNA Analyte-Specific Reagent James M. Barbeau, 1 Jennifer Goforth, 2 Angela M. Caliendo, 1 and Frederick S. Nolte 1 * Department of Pathology and Laboratory Medicine, Emory University School of Medicine, 1 and Emory Medical Laboratories, Emory University Hospital, 2 Atlanta, Georgia Received 12 February 2004/Returned for modification 7 April 2004/Accepted 7 May 2004 We determined the dynamic range, reproducibility, accuracy, genotype bias, and sensitivity of the TaqMan hepatitis C virus (HCV) analyte-specific reagent (ASR). Serum samples were processed using the MagNA Pure LC instrument and run on the COBAS TaqMan 48 analyzer. The performance characteristics of the ASR were also compared with those of the qualitative AMPLICOR and quantitative AMPLICOR MONITOR HCV tests. The ASR exhibited a >6-log 10 linear dynamic range and excellent reproducibility, with a mean coefficient of variation of 14%. HCV RNA concentration measured with the ASR agreed within an average of 0.42 log 10 (2.6-fold) of the labeled concentration with members of a standard reference panel. HCV genotypes 1 to 4 were amplified with similar efficiencies with the ASR. The ASR and AMPLICOR MONITOR viral load results were significantly correlated (r 0.8898; P < 0.01), but the agreement was poor (mean difference, 0.45 0.35 log 10 ) for 72 HCV RNA-positive clinical samples. However, 98.9% agreement between the ASR and qualitative AMPLICOR test results was found with 60 positive and 29 negative samples. Limiting-dilution experiments demonstrated that the limits of detection for ASR and AMPLICOR tests were 84 and 26 IU/ml, respectively. The performance characteristics of the TaqMan HCV ASR are appropriate for all clinical applications of HCV RNA testing. Both qualitative and quantitative hepatitis C virus (HCV) RNA tests are used in diagnosis and management of patients with hepatitis C, because no single commercially available test combines high analytical sensitivity with a broad dynamic range. Qualitative nucleic acid amplification tests for detection of HCV RNA in serum are used to confirm the diagnosis of hepatitis C, distinguish active from resolved infection, assess virological response to therapy, and screen blood donors (3, 18, 23). Quantitative tests are used in evaluation of patients being considered for therapy and to assess early response to therapy. A pretreatment viral load of less than 800,000 IU/ml is one of several predictors of a sustained virological response (20, 24). Viral load testing has also been used in early assessment of treatment response. Patients who fail to achieve at least a 2-log 10 decline in viral load after 12 weeks of treatment have little chance of a sustained response and can be spared the cost and toxicity of a complete treatment course (9, 17). However, viral load does not predict the progression of hepatitis C and is not associated with the severity of liver disease. A variety of tests for detection and quantitation of HCV RNA based on different nucleic acid amplification technolo- gies are commercially available. The qualitative AMPLICOR HCV and quantitative AMPLICOR HCV MONITOR version 2.0 tests (Roche Diagnostics Corporation, Indianapolis, Ind.) are based on conventional reverse transcription-PCR in a het- erogeneous format (17). The VERSANT HCV RNA qualita- tive and VERSANT HCV RNA 3.0 quantitative assays (Bayer Healthcare, Tarrytown, N.Y.) are based on transcription-me- diated amplification and branched DNA signal amplification, respectively (10, 15). These tests also differ in their lower limits of detection and dynamic ranges. The qualitative AMPLICOR and VERSANT tests have lower limits of detection of 50 and 5 IU/ml, respec- tively. Although the lower limits of detection for the quantita- tive AMPLICOR and VERSANT tests are both approximately 600 IU/ml, the dynamic ranges differ by approximately 1 log 10 and are 3.1 and 4.1 log 10 , respectively. Because of the differ- ences in sensitivity between the qualitative and quantitative assays, many clinical laboratories use a quantitative test to determine viral load and a sensitive qualitative test for diag- nosis and test-of-cure. A single test with sensitivity similar to the qualitative tests that accurately quantitates high viral loads would be beneficial for clinical laboratories. A number of homogeneous TaqMan reverse transcription- PCR assays for detection and quantitation of HCV RNA have been described (12, 13, 19, 21, 29). These tests are very sensi- tive, have broad dynamic ranges, and provide precise quanti- tation of viral load. These tests also generate results more rapidly than the earlier heterogeneous tests and are not prone to amplicon carry-over contamination, since the amplification and detection steps are combined in a single closed tube. Roche Diagnostics Corp. recently developed a TaqMan HCV analyte-specific reagent (ASR). It was designed for the newly released COBAS TaqMan analyzer, a real-time PCR instrument developed for the clinical laboratory. An ASR may be sold to clinical laboratories regulated under the Clinical Laboratory Improvement Amendments (CLIA) of 1998 as qualified to do high-complexity testing. The laboratory is re- sponsible for verifying and validating the test, and the reports should be appended with a standard disclaimer stating that the test was developed by and its performance characteristics de- * Corresponding author. Mailing address: Emory University Hospi- tal, Room F145, 1364 Clifton Rd. NE, Atlanta, GA 30322. Phone: (404) 712-7297. Fax: (404) 712-4632. E-mail: [email protected]. 3739 on October 14, 2018 by guest http://jcm.asm.org/ Downloaded from
Transcript
Page 1: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

JOURNAL OF CLINICAL MICROBIOLOGY, Aug. 2004, p. 3739–3746 Vol. 42, No. 80095-1137/04/$08.00�0 DOI: 10.1128/JCM.42.8.3739–3746.2004Copyright © 2004, American Society for Microbiology. All Rights Reserved.

Performance Characteristics of a Quantitative TaqMan Hepatitis CVirus RNA Analyte-Specific Reagent

James M. Barbeau,1 Jennifer Goforth,2 Angela M. Caliendo,1 and Frederick S. Nolte1*Department of Pathology and Laboratory Medicine, Emory University School of Medicine,1 and Emory

Medical Laboratories, Emory University Hospital,2 Atlanta, Georgia

Received 12 February 2004/Returned for modification 7 April 2004/Accepted 7 May 2004

We determined the dynamic range, reproducibility, accuracy, genotype bias, and sensitivity of the TaqManhepatitis C virus (HCV) analyte-specific reagent (ASR). Serum samples were processed using the MagNA PureLC instrument and run on the COBAS TaqMan 48 analyzer. The performance characteristics of the ASR werealso compared with those of the qualitative AMPLICOR and quantitative AMPLICOR MONITOR HCV tests.The ASR exhibited a >6-log10 linear dynamic range and excellent reproducibility, with a mean coefficient ofvariation of 14%. HCV RNA concentration measured with the ASR agreed within an average of 0.42 log10(2.6-fold) of the labeled concentration with members of a standard reference panel. HCV genotypes 1 to 4 wereamplified with similar efficiencies with the ASR. The ASR and AMPLICOR MONITOR viral load results weresignificantly correlated (r � 0.8898; P < 0.01), but the agreement was poor (mean difference, 0.45 � 0.35 log10)for 72 HCV RNA-positive clinical samples. However, 98.9% agreement between the ASR and qualitativeAMPLICOR test results was found with 60 positive and 29 negative samples. Limiting-dilution experimentsdemonstrated that the limits of detection for ASR and AMPLICOR tests were 84 and 26 IU/ml, respectively.The performance characteristics of the TaqMan HCV ASR are appropriate for all clinical applications of HCVRNA testing.

Both qualitative and quantitative hepatitis C virus (HCV)RNA tests are used in diagnosis and management of patientswith hepatitis C, because no single commercially available testcombines high analytical sensitivity with a broad dynamicrange. Qualitative nucleic acid amplification tests for detectionof HCV RNA in serum are used to confirm the diagnosis ofhepatitis C, distinguish active from resolved infection, assessvirological response to therapy, and screen blood donors (3, 18,23). Quantitative tests are used in evaluation of patients beingconsidered for therapy and to assess early response to therapy.A pretreatment viral load of less than 800,000 IU/ml is one ofseveral predictors of a sustained virological response (20, 24).Viral load testing has also been used in early assessment oftreatment response. Patients who fail to achieve at least a2-log10 decline in viral load after 12 weeks of treatment havelittle chance of a sustained response and can be spared the costand toxicity of a complete treatment course (9, 17). However,viral load does not predict the progression of hepatitis C and isnot associated with the severity of liver disease.

A variety of tests for detection and quantitation of HCVRNA based on different nucleic acid amplification technolo-gies are commercially available. The qualitative AMPLICORHCV and quantitative AMPLICOR HCV MONITOR version2.0 tests (Roche Diagnostics Corporation, Indianapolis, Ind.)are based on conventional reverse transcription-PCR in a het-erogeneous format (17). The VERSANT HCV RNA qualita-tive and VERSANT HCV RNA 3.0 quantitative assays (BayerHealthcare, Tarrytown, N.Y.) are based on transcription-me-

diated amplification and branched DNA signal amplification,respectively (10, 15).

These tests also differ in their lower limits of detection anddynamic ranges. The qualitative AMPLICOR and VERSANTtests have lower limits of detection of 50 and 5 IU/ml, respec-tively. Although the lower limits of detection for the quantita-tive AMPLICOR and VERSANT tests are both approximately600 IU/ml, the dynamic ranges differ by approximately 1 log10

and are 3.1 and 4.1 log10, respectively. Because of the differ-ences in sensitivity between the qualitative and quantitativeassays, many clinical laboratories use a quantitative test todetermine viral load and a sensitive qualitative test for diag-nosis and test-of-cure. A single test with sensitivity similar tothe qualitative tests that accurately quantitates high viral loadswould be beneficial for clinical laboratories.

A number of homogeneous TaqMan reverse transcription-PCR assays for detection and quantitation of HCV RNA havebeen described (12, 13, 19, 21, 29). These tests are very sensi-tive, have broad dynamic ranges, and provide precise quanti-tation of viral load. These tests also generate results morerapidly than the earlier heterogeneous tests and are not proneto amplicon carry-over contamination, since the amplificationand detection steps are combined in a single closed tube.

Roche Diagnostics Corp. recently developed a TaqManHCV analyte-specific reagent (ASR). It was designed for thenewly released COBAS TaqMan analyzer, a real-time PCRinstrument developed for the clinical laboratory. An ASR maybe sold to clinical laboratories regulated under the ClinicalLaboratory Improvement Amendments (CLIA) of 1998 asqualified to do high-complexity testing. The laboratory is re-sponsible for verifying and validating the test, and the reportsshould be appended with a standard disclaimer stating that thetest was developed by and its performance characteristics de-

* Corresponding author. Mailing address: Emory University Hospi-tal, Room F145, 1364 Clifton Rd. NE, Atlanta, GA 30322. Phone:(404) 712-7297. Fax: (404) 712-4632. E-mail: [email protected].

3739

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 2: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

termined by the laboratory and that the test has not beencleared or approved by the U.S. Food and Drug Administra-tion (FDA).

This study is the first to report the dynamic range, sensitivity,reproducibility, accuracy, and genotype bias of the ASR. Theperformance characteristics of the ASR were also comparedwith those of the qualitative AMPLICOR and quantitativeAMPLICOR MONITOR HCV version 2.0 tests.

MATERIALS AND METHODS

Samples. Serum samples were selected from stored samples that had beensubmitted to Emory Medical Laboratories for HCV RNA testing. The sera wereremoved from clots within 4 h of collection and stored at �70°C until needed. Astandard reference panel calibrated against the World Health Organization 1stInternational Standard for HCV RNA (25) was purchased from AcroMetrix,Benicia, Calif. The panel members were assigned concentrations of 50, 500,5,000, 200,000, 500,000, and 2,000,000 IU/ml by the manufacturer as previouslydescribed (11). All dilutions of clinical samples were made in human plasmaobtained from a single outdated unit from our blood bank.

Sample preparation. The starting sample volume for all of the tests was 200 �l.All samples tested in the AMPLICOR MONITOR HCV test were diluted 1:10in normal human plasma prior to processing. Samples for the other tests were notdiluted. HCV RNA was extracted from samples for the AMPLICOR MONI-TOR HCV test using the manual method according to the manufacturer’s in-structions. HCV RNA was extracted from serum samples for the AMPLICORHCV test using the MagNA Pure LC instrument and the total nucleic acidreagent set (Roche Applied Science, Indianapolis, Ind.) as previously described(7).

The MagNA Pure LC instrument and total nucleic acid reagent set were alsoused to extract HCV RNA for the ASR. The instrument and reagents were usedas recommended by the manufacturer with the following exceptions. The ASRquantitation standard (QS) was added to the lysis buffer to achieve a finalconcentration of 5 copies/�l (0.125 ml of HCV QS to 10 ml of lysis buffer). Thepurified RNA was eluted in 65 �l of elution buffer. The nominal concentrationof the HCV QS in the eluant was 22 copies/�l, as recommended for the TaqManHCV ASR by the manufacturer.

HCV RNA tests. The microwell plate AMPLICOR and AMPLICOR MON-ITOR HCV version 2.0 tests were performed according to the manufacturer’sinstructions. The ASR consists of an HCV master mix, a QS, and a 50 mMsolution of manganese acetate. The master mix contains upstream and down-stream primers to the 5� untranslated region of the HCV genome, fluorescentlylabeled HCV- and QS-specific oligonucleotide probes, Z05 DNA polymerase,deoxynucleotide triphosphates (dATP, dCTP, dGTP, and dUTP), AmpEraseuracil-N-glycosylase, potassium acetate, dimethyl sulfoxide, glycerol, and sodiumazide in tricine buffer. The HCV QS contains a noninfectious, protein-encapsu-lated RNA with the HCV primer binding sequences and a unique probe bindingregion at a concentration of 400 copies/�l, poly(rA) RNA, EDTA, amaranth dye,and ProClin 300 in sodium phosphate buffer. Single lots of master mix and QSwere used throughout the study.

The master mix was activated by the addition of 170 �l of 50 mM manganeseacetate, and the activated master mix was used within 60 min of preparation.Fifty microliters of processed sample or calibrator was added to 50 �l of acti-vated master mix. The amplification and detection reactions were started within30 min of the addition of the sample. Thermal cycle parameters were as follows:two precycles of 5 min at 50°C and 30 min at 59°C, two cycles of 15 s at 95°C and25 s at 58°C, and 60 cycles of 15 s at 91°C and 25 s at 58°C, followed by a postcyclehold at 40°C.

The ASR was run on the COBAS TaqMan 48 analyzer. It is a real-time PCRinstrument designed for the clinical laboratory that consists of two independentlyprogrammable, 24-sample thermal cyclers, a halogen light source, two 24-chan-nel fluorescence photometers with four different filter combinations, and Am-plilink software. It has a run size of 6 to 48 samples.

The ASR was calibrated by using serial 10-fold dilutions of a well-character-ized clinical specimen containing HCV genotype 1 that were tested at sevendifferent levels in quadruplicate in a single run. The starting concentration wasassigned using the AMPLICOR HCV MONITOR test. The threshold or elbowvalues (EVs) for both HCV and QS were stored and used by the instrumentsoftware to determine the lot-specific calibration coefficients that were used incalculation of the sample HCV RNA concentrations.

HCV genotyping. HCV genotypes were determined using a commerciallyavailable reverse hybridization, line probe assay (VERSANT HCV GenotypeAssay; Bayer Healthcare) according to the manufacturer’s instructions. Theamplicon from the 5� untranslated region used in the genotyping assay wasgenerated with the AMPLICOR HCV test.

Data analysis. Descriptive statistics, correlation coefficients, and regressionline equations were calculated with the data analysis tool pack of Microsoft Excel2000 (Microsoft Corp., Redmond, Wash.). Agreement between viral load valueswas assessed by the method of Bland and Altman (2). The limits of detectionwere determined using probit analysis (8).

RESULTS

The sample that was used to calibrate the ASR was assigneda starting concentration of 4 � 106 (6.58 log10) IU/ml with theAMPLICOR HCV MONITOR test. The undiluted sampleand six serial 10-fold dilutions were tested in 11 replicates inthree separate runs. The mean, standard deviation, and coef-ficient of variation (CV) of the EVs for each calibrator areshown in Table 1. The EVs were very reproducible over theentire concentration range, with CVs ranging from 0.48 to2.47%. The ASR detected 100% of the replicates containinggreater than or equal to 40 IU/ml and 73% of the replicatescontaining the lowest concentration tested, 4 IU/ml. The meanEVs and HCV RNA concentrations were highly correlated (r� 0.9961), and the assay showed a linear response over the6-log10 range of concentrations tested. The calibration coeffi-cients used to calculate the sample HCV RNA concentrationsin subsequent experiments were derived from these data.

A second set of six serial 10-fold dilutions was prepared fromanother clinical sample with a higher starting concentration of18,400,000 (7.27 log10) IU/ml as determined with the AMPLI-COR HCV MONITOR test. The undiluted sample and thedilutions were tested in quadruplicate in a single ASR run. Theplot of the measured values against the expected values isshown in Fig. 1. The measured and expected values were highlycorrelated (r � 0.9996) over the 6-log10 concentration range,and the equation for the linear regression line was y � 1.036x� 0.83. The slope of the line closely approximated the idealslope of 1. The measured values were consistently larger thanthe expected values, with an average bias of 0.24 log10 (range,0.1 to 0.37) or 1.7-fold. The average CV for the replicate viralload values in this dilution series was 13.9% (range, 6.6 to19.9).

We prepared serial dilutions of two other high-titer clinicalsamples containing 90,000,000 (7.95 log10) and 270,000,000(8.43 log10) IU/ml to test the upper limit of the dynamic rangeof the ASR. The initial concentrations were assigned with the

TABLE 1. Reproducibility of EVs for the TaqMan HCVASR calibratorsa

HCV RNA(IU/ml) No. detected/no. tested Mean EV SD % CV

4,000,000 11/11 22.97 0.272 1.19400,000 11/11 26.38 0.199 0.7540,000 11/11 29.72 0.252 0.854,000 11/11 32.62 0.204 0.63

400 11/11 34.60 0.167 0.4840 11/11 37.21 0.599 1.614 8/11 40.8 0.976 2.47

a Eleven replicates at each concentration were tested in three separate runs.

3740 BARBEAU ET AL. J. CLIN. MICROBIOL.

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 3: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

ASR. The equations for the regression lines of the two dilutionseries were very similar, and the ASR demonstrated no devi-ation from the ideal response up to the highest concentrationtested (Fig. 2). The upper limit of the linear range was at least7.95 log10 IU/ml.

A standard reference panel was used to assess the accuracyof the ASR calibration. The panel consisted of seven memberswith concentrations ranging from 50 to 2,000,000 IU/ml. Thepanel was tested in quadruplicate in a single run. HCV RNAwas detected in all replicates at each concentration. The viralload values determined for all panel members containing �50IU/ml were very reproducible, with an average CV of 14%, andwere consistently greater than the labeled concentration by anaverage of 0.42 log10 (2.6-fold) (Table 2). Although HCV RNAwas detected in all the replicates of the 50-IU/ml panel mem-ber, the viral load value determined by the ASR, 6 IU/ml, wasalmost 1 log10 less than the labeled concentration and the assayat this concentration was poorly reproducible, with a CV of53%. The measured versus labeled concentrations for all of thepanel members except the 50-IU/ml member are plotted inFig. 3. The values were highly correlated (r � 0.9979), and theslope of the linear regression line was 1.002. The line shows aconsistent positive bias for the values determined with theASR.

We next examined the correlation and agreement of viralload values determined with the ASR and the AMPLICORMONITOR test for a total of 71 clinical samples: 61 withgenotype 1, 4 with genotype 2, 4 with genotype 3, and 1 with

genotype 4 HCV RNA. The population means (ranges) of theviral load values determined with the ASR and the MONITORtest were 6.5 (3.28) and 6.06 (2.43) log10, respectively. Thevalues were significantly correlated (r � 0.8898; P � 0.01), andthe linear regression analyses indicated that the slope andintercept were not significantly different from 1 and 0, respec-tively (Fig. 4). However, the agreement was poor, with a meandifference between values (ASR and MONITOR) of 0.45log10 0.35. The limits of agreement (mean difference 2standard deviations) were �0.25 and 1.15 log10.

A plot of the difference versus the average viral load valuesfor the 71 samples is shown in Fig. 5. We estimated the trueviral load value for each sample by averaging the results of thetwo tests, since the true values were not determined with anindependent reference test. The ASR values were consistentlygreater than the MONITOR values; however, the differencebetween the values measured by the two tests varied with theconcentration (r � 0.6156; P � 0.01). The differences betweenvalues were consistently less than the mean difference for sam-ples, with average viral load values of �6 log10 IU/ml, equallydistributed around the mean difference for samples with aver-age viral load values between 6 and 6.5 log10 IU/ml, and con-sistently greater than the mean difference for samples, withaverage viral load values of �6.5 log10 IU/ml.

Serial 10-fold dilutions of clinical samples containing HCVgenotypes 2, 3, and 4 were prepared and tested with the ASR.The EVs were plotted against the log10 of the HCV RNAconcentration, and data were analyzed by linear regression

FIG. 1. Measured versus expected concentrations of serial 10-fold dilutions of a sample with a starting concentration of 7.27 log10 IU/ml. Thestarting concentration was determined with the AMPLICOR HCV MONITOR test. Each point represents the mean of four replicates tested ina single run. The dashed line represents unity.

VOL. 42, 2004 TaqMan HCV ASR 3741

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 4: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

(results not shown). The slope of the regression line is a mea-sure of reaction efficiency for real-time PCR. The slopes forgenotypes 2, 3, and 4 were �2.95, �2.65, and �3.13, respec-tively. The regression line slope for the genotype 1 calibratorwas �2.73 (Fig. 1). The slopes of the regression lines for thedifferent genotypes were not significantly different. The ASRamplified all of the different genotypes with similar efficiencies.

We tested the 89 clinical samples in parallel with the qual-itative AMPLICOR HCV test and the ASR. The results of thetwo tests agreed for 98.9% of the samples (Table 3). HCVRNA was detected by both tests in 59 samples and not detectedby both tests in 29 samples. HCV RNA was detected only withthe AMPLICOR test in one sample. The sensitivity and spec-

ificity of the ASR with respect to the AMPLICOR test were98.3 and 100%, respectively.

The limits of detection of the qualitative AMPLICOR HCVtest and the ASR were determined and compared using serialdilutions of a reference standard with a labeled concentrationof 5,000 IU/ml (Table 4). HCV RNA was detected in 100% ofthe replicates at a concentration of 500 IU/ml with the ASR. Atconcentrations of �500 IU/ml, the detection failure rate withthe ASR increased as the concentration of HCV RNA de-creased. The AMPLICOR test detected HCV RNA in 100%of replicates at concentrations of �50 IU/ml by the AMPLI-COR test, and proportionally fewer replicates were detected atlower concentrations. Probit analysis indicated that the con-centration at which 95% of the replicates should be positive(limit of detection) was 84 IU/ml for the ASR and 26 IU/ml forthe AMPLICOR test.

DISCUSSION

The TaqMan HCV ASR is an example of a reagent that canbe marketed to clinical laboratories under the ASR rule (5).Simply stated, an ASR is the active ingredient of an in-labo-ratory-developed test. The ASR rule was intended to facilitatethe transfer of new technology to clinical laboratories, partic-ularly to those high-complexity laboratories capable of usingthese reagents in the development of new diagnostic tests.

Under the ASR rule manufacturers are not required to seek

FIG. 2. Measured versus expected concentrations of serial dilutions of two high-titer samples. �, sample 1; ■, sample 2. The startingconcentrations were determined with the TaqMan HCV ASR (sample 1, 8.43 log10 IU/ml; sample 2, 7.95 log10 IU/ml). Each point represents theaverage of duplicates tested in a single run. The dashed line represents unity.

TABLE 2. Reproducibility and accuracy of the TaqMan HCV ASRdetermined with a standard reference panel of HCV RNA

Labeled concn(IU/ml)

Measuredconcna (IU/ml) SD CV (%) Bias (log10)

2,000,000 6,950,000 862,300 12 0.54500,000 1,050,000 159,400 15 0.32200,000 538,000 70,220 13 0.4350,000 109,000 3610 3 0.345,000 12,200 1940 16 0.39

500 1,500 390 26 0.4850 6 9 53 �0.92

a Each concentration was tested in quadruplicate. HCV RNA was detected inall of the replicates.

3742 BARBEAU ET AL. J. CLIN. MICROBIOL.

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 5: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

FDA premarket approval for low-risk ASRs, which include allbut blood banking tests, and those used for the diagnosis ofpotentially deadly infectious diseases (e.g., tuberculosis andAIDS) and genetic disorders. To qualify for the regulatoryexemptions, the manufacturer cannot make analytical or clin-ical performance claims. It also cannot provide clinical labo-ratories with instructions on how to use the ASR or withappropriate calibrators and controls. In addition, the manufac-turer is required to register and list the ASR with the FDA, tomeet good manufacturing process standards, to report adverseevents, and to restrict the distribution of the ASR to CLIAhigh-complexity laboratories. The clinical laboratories are re-quired to develop and maintain the analytical performancecharacteristics of the test in which the ASR is used and toreport the test results with a standard disclaimer.

Roche also markets a research-use-only (RUO) version ofthe TaqMan HCV RNA test. The reagents in an RUO test arecalibrated by the manufacturer and come with additional con-trols and instructions for use. However, clinical laboratoriesthat use the RUO test are still required to determine its localperformance characteristics under CLIA 1998. Clinical labo-ratories may use either the ASR or the RUO kit for all theclinical applications of HCV RNA testing except testing ofblood donors.

The TaqMan HCV ASR demonstrated a very broad dy-namic range of at least 6 log10 IU/ml. The dynamic range forthe ASR may actually be even broader, since with at least onesample we were able to document linearity of the assay up to270,000,000 IU/ml. Even with the more conservative estimate

of 6 log10, the ASR has a much broader dynamic range thaneither of the other commercially available quantitative HCVassays, the AMPLICOR HCV MONITOR version 2.0 (3.1log10) and the VERSANT HCV RNA 3.0 (4.1 log10). Thedynamic range is comparable to that described for in-labora-tory-developed, real-time PCR assays for HCV RNA. We wereunable to adequately characterize the performance of the ASRat the upper end of the dynamic range due to the scarcity ofclinical samples and reference material with viral loads of inexcess of 108 IU/ml. Based on our data, we estimate that theASR can precisely determine viral loads from 500 to200,000,000 IU/ml. The broad dynamic range of the ASRmakes it well suited for assessing viral loads throughout acourse of treatment.

The user defines the calibrators for the ASR. We chose tocalibrate it using a clinical sample that was assigned a viral loadvalue with the AMPLICOR HCV MONITOR test. A clinicalsample was used rather than standard reference material be-cause of the lack of available high-titer reference material. Weused the AMPLICOR HCV MONITOR test to assign theinitial concentration because it is commonly used in clinicallaboratories and it is calibrated against the World Health Or-ganization HCV international standard. We found that thestandard curve was stable when using the same lot of reagents,with an average CV in the EVs of only 1.1% over three runs.A single standard curve can be run once in quadruplicate togenerate lot-specific calibration coefficients.

The accuracy of the calibration was checked with a commer-cially available standard reference panel. The values deter-

FIG. 3. Measured versus labeled concentrations for a standard reference panel of HCV RNA tested with the TaqMan HCV ASR. Each pointrepresents the mean of four replicates tested in a single run. The dashed line represents unity.

VOL. 42, 2004 TaqMan HCV ASR 3743

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 6: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

mined with the ASR were consistently 2.6-fold greater than thelabeled concentrations from 100 to 2,000,000 IU/ml. Agree-ment within threefold is generally considered acceptable whencomparing different methods for HCV viral load measurement(28).

The within-run precision of the ASR viral load measure-ments was assessed with a standard reference panel and serialdilutions of a clinical sample. In each case, the average CVover the dynamic range was approximately 14%. Given thislevel of variation, a greater-than-twofold (0.3 log10) differencebetween samples will be statistically significant (P � 0.05) overmost of the dynamic range of the assay. At either end of thedynamic range, threefold (0.5 log10) differences will be statis-tically significant (P � 0.05). The precision of the ASR com-pares favorably with the precision reported for the AMPLI-COR HCV MONITOR version 2.0 test (16) and is similar tothat reported for the VERSANT HCV RNA 3.0 assay (1, 30).

We found significant correlation but poor agreement be-tween the results obtained with the ASR and the AMPLICORMONITOR test for the same clinical samples. The averagedifference between the results was 0.45 log10, and the differ-ence increased as the viral load increased. This is best ex-plained by differences in the true dynamic ranges of the twotests. Although the upper limit of the linear range claimed bythe manufacturer for the AMPLICOR MONITOR test is850,000 IU/ml, other studies indicate that the test plateaus atconcentrations above 500,000 IU/ml (14, 16, 22). Significantvariation between values from diluted and undiluted sampleswas observed in those studies with samples in the range of

500,000 to 850,000 IU/ml. We diluted all samples 1:10 prior totesting with the AMPLICOR MONITOR to permit betterquantitation of samples with high viral loads, and we used8,500,000 IU/ml as the upper limit of the linear range. Thesharp increase in the magnitude of the differences between testresults with samples with mean viral loads greater than3,200,000 (6.5 log10) observed here suggests that the dynamicrange of the AMPLICOR MONITOR test is more limitedthan previously reported.

Genotype bias was a significant problem with the first ver-sion of the AMPLICOR HCV MONITOR test, due to sec-ondary structures that could form in the target cDNA at therelatively low annealing and extension temperatures used. Thiswas addressed by reformulation of the PCR mixture and mod-ification of the thermal cycle parameters in the version 2.0 test.The version 2.0 test amplifies all HCV genotypes with similarefficiency (6, 16). A prototype of the TaqMan HCV ASR wasalso shown to amplify RNA transcripts from the different HCVgenotypes with comparable efficiencies (13). We demonstratedthat the ASR amplification efficiencies were similar for clinicalsamples with HCV genotypes 1 to 4. Like the AMPLICORMONITOR version 2.0 and prototype TaqMan tests, the ASRwas free of significant genotype bias.

The clinical and analytical sensitivities of the ASR werecompared with those for the qualitative AMPLICOR HCVtest. We found that the ASR detected all but 1 of the 60positive clinical samples tested in parallel (sensitivity, 98.3%)and that the limits of detection were similar: 84 IU/ml for theASR and 26 IU/ml for the AMPLICOR test. Since the same

FIG. 4. Correlation and linear regression analysis of viral load values obtained with the TaqMan HCV ASR and the AMPLICOR HCVMONITOR test. HCV genotypes are indicated as follows: �, genotype 1; ■, genotype 2; Œ, genotype 3; �, genotype 4.

3744 BARBEAU ET AL. J. CLIN. MICROBIOL.

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 7: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

sample volume, nucleic acid extraction protocol, and reactioninput volume were used for both tests, the difference in thelimits of detection may have resulted from small differences inPCR efficiencies between the tests. The small difference inanalytical sensitivity is unlikely to have a major impact on theperformance of the ASR when it is used to diagnose activeinfections, since it is rare for pretreatment viral load values tobe less than 100,000 IU/ml.

The analytical sensitivity required to adequately assess end-of-treatment virological responses in HCV infection is not wellestablished. The VERSANT HCV RNA assay, with a 5-IU/mllimit of detection, was able to detect residual serum viral RNAin some patients who had no detectable viral RNA in theAMPLICOR HCV test at the end of treatment with interferonand subsequently experienced a virological relapse (4, 27).However, no difference between the tests was observed withend-of-treatment samples from patients treated with thenewer, faster-acting, polyethylene glycol-modified interferon

(26). It is unlikely that small differences in analytical sensitivitywill be important in the assessment of end-of-treatment viro-logical responses in patients treated with the most effectiveregimens.

The manual extraction protocol given as an example by themanufacturer in the ASR package insert uses a sample inputvolume of 500 �l. We used automated processing and a 200-�linput. The larger sample volume could improve the limit ofdetection by as much as 2.5-fold.

The COBAS TaqMan 48 analyzer is the first real-time PCRinstrument designed for the clinical laboratory. The instrumentwas simple to use and was reliable over the 6-month evaluationperiod. The software allowed storage of patient demographic

FIG. 5. Agreement of viral load values obtained with the TaqMan HCV ASR and the AMPLICOR HCV MONITOR test. Difference log10IU/ml � ASR value � MONITOR value. Average log10/IU/ml � (ASR value � MONITOR value)/2. HCV genotypes are indicated as follows:�, genotype 1; ■, genotype 2; Œ, genotype 3; �, genotype 4.

TABLE 3. Qualitative results obtained with the AMPLICOR HCVtest and the TaqMan HCV ASR for 89 clinical samples

AMPLICORresult

ASR resultTotal

Detected Not detected

Positive 59 1 60Negative 0 29 29Total 59 30

TABLE 4. Limits of detection for the AMPLICOR HCV test andthe TaqMan HCV ASR

HCV concn(IU/ml)a

AMPLICOR ASR

No.tested

No.(%)

positive

No.tested

No.(%)

positive

500 8 8 (100) 8 8 (100)100 16 16 (100) 16 15 (93.5)50 16 16 (100) 16 12 (75)25 16 12 (75) 16 11 (68.8)12.5 16 9 (56.3) 16 9 (56.3)

a Serial dilutions were made from a reference standard with a labeled concen-tration of 5,000 IU/ml (AcroMetrix) to the indicated concentration.

VOL. 42, 2004 TaqMan HCV ASR 3745

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from

Page 8: Performance Characteristics of a Quantitative TaqMan Hepatitis …jcm.asm.org/content/42/8/3739.full.pdf · TOR HCV test using the manual method according to the manufacturer’s

and order data, which is helpful for clinical laboratories. How-ever, unlike research instruments, the software did not gener-ate amplification plots or multicomponent views, which can bevery helpful in troubleshooting real-time PCR.

In conclusion, the TaqMan HCV ASR and the COBASTaqMan 48 analyzer are among the first real-time PCR assaysand platforms designed specifically for the clinical laboratory.Together they represent a powerful new tool for quantitationof HCV RNA and can provide a single assay platform that hasthe required combination of analytical sensitivity, dynamicrange, and precision for all the current clinical applications ofHCV RNA testing.

ACKNOWLEDGMENT

This study was supported in part by a grant from Roche DiagnosticsCorp.

REFERENCES

1. Beld, M., R. Sentjens, S. Rebers, C. Weegink, J. Weel, C. Sol, and R. Boom.2002. Performance of the new Bayer VERSANT HCV RNA 3.0 assay forquantitation of hepatitis C virus RNA in plasma and serum: conversion tointernational units and comparison with the Roche COBAS Amplicor HCVmonitor, version 2.0, assay. J. Clin. Microbiol. 40:788–793.

2. Bland, J. M., and D. G. Altman. 1986. Statistical methods for assessingagreement between two methods of clinical measurement. Lancet i:307–310.

3. Centers for Disease Control and Prevention. 1998. Recommendations forprevention and control of hepatitis C virus (HCV) infection and HCV-related chronic disease. Morb. Mortal. Wkly. Rep. 47:1–39.

4. Comanor, L., F. Anderson, M. Ghany, R. Perrillo, E. J. Heathcote, C.Sherlock, I. Zitron, D. Hendricks, and S. C. Gordon. 2001. Transcription-mediated amplification is more sensitive than conventional PCR-based as-says for detecting residual serum HCV RNA at end of treatment. Am. J.Gastroenterol. 96:2968–2972.

5. Department of Health and Human Services, Food and Drug Administration.1997. Medical devices; classification/reclassification; restricted devices; ana-lyte specific reagents. Final rule. Fed. Regist. 62:62243–62259.

6. Doglio, A., C. Laffont, F. X. Caroli-Bosc, P. Rochet, and J.-C. Lefebvre. 1999.Second generation of the automated Cobas Amplicor HCV assay improvessensitivity of hepatitis C virus RNA detection and yields results that are moreclinically relevant. J. Clin. Microbiol. 37:1567–1569.

7. Fiebelkorn, K. R., B. G. Lee, C. E. Hill, A. M. Caliendo, and F. S. Nolte. 2002.Clinical evaluation of an automated nucleic acid isolation system. Clin.Chem. 48:1613–1615.

8. Finney, D. J. 1971. Probit analysis, 3rd ed. Cambridge University Press,London, England.

9. Fried, M. W., M. L. Shiffman, K. R. Reddy, C. Smith, G. Marinos, F. L.Goncales, Jr., D. Haussinger, M. Diago, G. Carosi, D. Dhumeaux, A. Craxi,A. Lin, J. Hoffman, and J. Yu. 2002. Peginterferon alfa-2a plus ribavirin forchronic hepatitis C virus infection. N. Engl. J. Med. 347:975–982.

10. Germer, J. J., P. J. Heimgartner, D. M. Ilstrup, W. S. Harmsen, G. D.Jenkins, and R. Patel. 2002. Comparative evaluation of the VERSANTHCV RNA 3.0, QUANTIPLEX HCV RNA 2.0, and COBAS AMPLICORHCV MONITOR version 2.0 assays for quantification of hepatitis C virusRNA in serum. J. Clin. Microbiol. 40:495–500. [Erratum, 40:1885.]

11. Jorgensen, P. A., and P. D. Neuwald. 2001. Standardized hepatitis C virusRNA panels for nucleic acid testing assays. J. Clin. Virol. 20:35–40.

12. Kawai, S., O. Yokosuka, T. Kanda, F. Imazeki, Y. Maru, and H. Saisho.1999. Quantification of hepatitis C virus by TaqMan PCR: comparison withHCV Amplicor Monitor assay. J. Med. Virol. 58:121–126.

13. Kleiber, J., T. Walter, G. Haberhausen, S. Tsang, R. Babiel, and M. Rosen-

straus. 2000. Performance characteristics of a quantitative, homogeneousTaqMan RT-PCR test for HCV RNA. J. Mol. Diagn. 2:158–166.

14. Konnick, E. Q., M. Erali, E. R. Ashwood, and D. R. Hillyard. 2002. Perfor-mance characteristics of the COBAS Amplicor hepatitis C virus (HCV)Monitor, version 2.0, international unit assay and the National GeneticsInstitute HCV Superquant assay. J. Clin. Microbiol. 40:768–773.

15. Krajden, M., R. Ziermann, A. Khan, A. Mak, K. Leung, D. Hendricks, andL. Comanor. 2002. Qualitative detection of hepatitis C virus RNA: compar-ison of analytical sensitivity, clinical performance, and workflow of the CobasAmplicor HCV test version 2.0 and the HCV RNA transcription-mediatedamplification qualitative assay. J. Clin. Microbiol. 40:2903–2907.

16. Lee, S. C., A. Antony, N. Lee, J. Leibow, J. Q. Yang, S. Soviero, K. Gutekunst,and M. Rosenstraus. 2000. Improved version 2.0 qualitative and quantitativeAMPLICOR reverse transcription-PCR tests for hepatitis C virus RNA:calibration to international units, enhanced genotype reactivity, and perfor-mance characteristics. J. Clin. Microbiol. 38:4171–4179.

17. Lee, S. S., E. J. Heathcote, K. R. Reddy, S. Zeuzem, M. W. Fried, T. L.Wright, P. J. Pockros, D. Haussinger, C. I. Smith, A. Lin, and S. C. Pappas.2002. Prognostic factors and early predictability of sustained viral responsewith peginterferon alfa-2a (40KD). J. Hepatol. 37:500–506.

18. Legler, T. J., J. Riggert, G. Simson, C. Wolf, A. Humpe, U. Munzel, A. Uy, M.Kohler, and K. H. Heermann. 2000. Testing of individual blood donationsfor HCV RNA reduces the residual risk of transfusion-transmitted HCVinfection. Transfusion 40:1192–1197.

19. Martell, M., J. Gomez, J. I. Esteban, S. Sauleda, J. Quer, B. Cabot, R.Esteban, and J. Guardia. 1999. High-throughput real-time reverse transcrip-tion-PCR quantitation of hepatitis C virus RNA. J. Clin. Microbiol. 37:327–332.

20. McHutchinson, J. G., S. C. Gordon, E. R. Schiff, M. L. Shiffman, W. M. Lee,V. K. Rustgi, Z. D. Goodman, M.-H. Ling, S. Cort, and J. K. Albrecht. 1998.Interferon alfa-2b alone or in combination with ribavirin as initial treatmentfor chronic hepatitis C. N. Engl. J. Med. 339:1485–1492.

21. Mercier, B., L. Burlot, and C. Ferec. 1999. Simultaneous screening for HBVDNA and HCV RNA genomes in blood donations using a novel TaqManPCR assay. J. Virol. Methods 77:1–9.

22. Morishima, C., M. Chung, K. W. Ng, D. J. Brambilla, and D. R. Gretch.2004. Strengths and limitations of commercial tests for hepatitis C virusRNA quantification. J. Clin. Microbiol. 42:421–425.

23. National Institutes of Health. 2002. Management of hepatitis C: 2002. NIHConsensus and State-of-the-Science Statements 19(3):1–46.

24. Poynard, T., P. Marcellin, S. S. Lee, C. Niederau, G. S. Minuk, G. Ideo, V.Bain, J. Heathcote, S. Zeuzem, C. Trepo, and J. Albrecht. 1998. Randomisedtrial of interferon 2b plus ribavirin for 48 weeks or for 24 weeks verusinteron 2b plus placebo for 48 weeks for treatment of chronic infection withhepatitis C virus. Lancet 352:1426–1432.

25. Saldanha, J., N. Lelie, A. Heath, et al. 1999. Establishment of the firstinternational standard for nucleic acid amplification technology (NAT) as-says for HCV RNA. Vox Sang. 76:149–158.

26. Sarrazin, C., D. A. Hendricks, F. Sedarati, and S. Zeuzem. 2001. Assess-ment, by transcription-mediated amplification, of virologic response in pa-tients with chronic hepatitis C virus treated with peginterferon 2a. J. Clin.Microbiol. 39:2850–2855.

27. Sarrazin, C., G. Teuber, R. Kokka, H. Rabenau, and S. Zeuzem. 2000.Detection of residual hepatitis C virus RNA by transcription-mediated am-plification in patients with complete virologic response according to poly-merase chain reaction-based assays. Hepatology 32:818–823.

28. Schirm, J., A. M. van Loon, E. Valentine-Thon, P. E. Klapper, J. Reid, andG. M. Cleator. 2002. External quality assessment program for qualitative andquantitative detection of hepatitis C virus RNA in diagnostic virology.J. Clin. Microbiol. 40:2973–2980.

29. Takeuchi, T., A. Katsume, T. Tanaka, A. Abe, K. Inoue, K. Tsukiyama-Kohara, R. Kawaguchi, S. Tanaka, and M. Kohara. 1999. Real-time detec-tion system for quantification of hepatitis C virus genome. Gastroenterology116:636–642.

30. Trimoulet, P., P. Halfon, E. Pohier, H. Khiri, G. Chene, and H. Fleury. 2002.Evaluation of the VERSANT HCV RNA 3.0 assay for quantification ofhepatitis C virus RNA in serum. J. Clin. Microbiol. 40:2031–2036.

3746 BARBEAU ET AL. J. CLIN. MICROBIOL.

on October 14, 2018 by guest

http://jcm.asm

.org/D

ownloaded from


Recommended