+ All Categories
Home > Documents > Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and...

Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and...

Date post: 06-Jul-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
60
1 2016 Online Annexes (5-8) to WHO Policy guidance: The use of molecular line probe assay for the detection of resistance to second-line anti-tuberculosis drugs
Transcript
Page 1: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

1

2016

Online Annexes (5-8)

to

WHO Policy guidance: The use of molecular line

probe assay for the detection of resistance to

second-line anti-tuberculosis drugs

Page 2: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

2

Contents:

Annex 5: GRADE summary of findings tables……………………………………………………………………………………………………………………………………….3

Annex 6: Evidence to recommendations tables………………………………..……………………………………………………………………………………….……….15

Annex 7. Drug concentrations used in culture-based DST for each included study…………………………………………………………………………..…51

Annex 8. References to studies excluded from the review of the diagnostic accuracy of MTBDRsl assay……………………………………………56

THIS IS THE FINAL VERSION OF THE WHO POLICY DOCUMENT APPROVED

BY THE WHO GUIDELINES REVIEW COMMITTEE.

THE FINAL FORMATTED VERSION OF THE GUIDELINES AND APPENDICES 5,6,7 AND 8

WILL BE AVAILABLE ONLINE IN EARLY JUNE 2016 AT :

www.who.int/tb/areas-of-work/laboratory/policy_statements/en/

Page 3: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

3

Annex 5. GRADE summary of findings tables

Table 1. Accuracy of MTBDRsl by direct testing for detection of fluoroquinolone resistance in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by direct testing for detection of FQ resistance in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture to diagnose TB

detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).5 The test was performed by direct testing on smear-positive specimens

Reference standard: Culture-based drug susceptibility testing

Studies: Mainly cross-sectional studies

Sensitivity 0.86 (95% CI: 0.75 to 0.93)

Specificity 0.99 (95% CI: 0.97 to 0.99)

Prevalences 5% 10% 15%

Outcome

Number of studies

(Number of patients)

Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested

Test accuracy QoE

Risk of bias Indirectness Inconsistency Imprecision Publication

bias

Pre-test probability of

5%

Pre-test probability of

10%

Pre-test probability of

15%

True positives (patients with FQ resistance)

9 studies 519 patients

cross-sectional (cohort type accuracy study)

1

not serious 2 not serious

3 serious

4 not serious none 43 (37 to 47) 86 (75 to 93) 129 (112 to

140) ⨁⨁⨁◯

MODERATE

False negatives (patients incorrectly classified as not having FQ resistance)

7 (3 to 13) 14 (7 to 25) 21 (10 to 38)

True negatives (patients without FQ resistance)

9 studies 1252 patients

cross-sectional (cohort type accuracy study)

1

not serious 2 not serious

3 not serious not serious none 937 (921 to

944) 887 (872 to 895)

838 (824 to 845)

⨁⨁⨁⨁ HIGH

False positives (patients incorrectly classified as having FQ resistance)

13 (6 to 29) 13 (5 to 28) 12 (5 to 26)

Page 4: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

4

Footnotes.

1. Eight studies used a cross-sectional study design and one study used a case-control study design.

2. The QUADAS-2 tool was used to assess the risk of bias. All studies used consecutive sampling. In seven studies, the reader of the index test was blinded to results of the

reference standard and in two studies information about blinding to the reference standard was not reported. Several studies used critical concentrations for the

phenotypic culture-based reference standard that differed from the concentrations recommended by WHO. This may have lowered specificity, but this was not observed.

The evidence was not downgraded.

3. There was low concern for applicability. Given that the test's high specificity and ability to provide results within a matter of days, the test might improve patient

outcomes by enabling earlier initiation of appropriate therapy. The evidence was not downgraded.

4. For individual studies, sensitivity estimates ranged from 33% to 100%. One small study with the lowest sensitivity only included three fluoroquinolone-resistant patients.

However, the remaining heterogeneity could not be explained by study quality or other factors. The evidence was downgraded one point

5. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl

(version 1.0). Therefore the findings in this review should be considered applicable to the test.

Page 5: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

5

Table 2. Accuracy of MTBDRsl by direct testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by direct testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture to diagnose TB

detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).5 The test was performed by direct testing on smear-positive specimens

Reference standard: Culture-based drug susceptibility testing

Studies: Mainly cross-sectional studies

Sensitivity 0.87 (95% CI: 0.38 to 0.99)

Specificity 0.99 (95% CI: 0.94 to 1.00)

Prevalences 5% 10% 15%

Outcome Number of studies

(Number of patients)

Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested Test

accuracy QoE

Risk of bias

Indirectness

Inconsistency Imprecision Publication

bias

Pre-test probability of

5%

Pre-test probability of

10%

Pre-test probability of

15%

True positives (patients with SLID resistance)

8 studies 348 patients

cross-sectional (cohort type accuracy study)

serious 1

not serious 2

not serious 3 serious

4 none 44 (19 to 49) 87 (38 to 99) 131 (57 to 148) ⨁⨁◯◯

LOW

False negatives (patients incorrectly classified as not having SLID resistance)

6 (1 to 31) 13 (1 to 62) 19 (2 to 93)

True negatives (patients without SLID resistance)

8 studies 1291 patients

cross-sectional (cohort type accuracy study)

serious 1

not serious 2

not serious not serious none 945 (889 to 950)

896 (842 to 900)

846 (796 to 850)

⨁⨁⨁◯

MODERATE

False positives (patients incorrectly classified as having SLID resistance)

5 (0 to 61) 4 (0 to 58) 4 (0 to 54)

Page 6: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

6

Footnotes

1. The QUADAS-2 was used to assess the risk of bias. All studies used consecutive or random sampling. In six studies, the reader of the index test was blinded to results of

the reference standard in two studies information about blinding to the reference standard was not reported. Fifty percent of the studies used critical concentrations for

the phenotypic culture-based reference standard that differed from the concentrations recommended by WHO. The evidence was downgraded by one point.

2. There was low concern for applicability. Given the test's high specificity and ability to provide results within a matter of days, the test might improve patient outcomes by

enabling earlier initiation of appropriate therapy. The evidence was not downgraded.

3. For individual studies, sensitivity estimates ranged from 9% to 100%. The variability was explained in part by the use of different drugs, critical concentrations, and types

of culture media in the reference standard and likely presence of eis resistance-conferring mutations in patients in Eastern European countries. The evidence was not

downgraded and considered this in the context of other factors, in particular imprecision.

4. The wide confidence interval around true positives and false negatives may lead to different decisions depending on which confidence limits are assumed. The evidence

was downgraded by one point.

5. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl

(version 1.0). Therefore the findings in this review should be considered applicable to the test.

Page 7: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

7

Table 3. Accuracy of MTBDRsl by indirect testing for detection of FQ resistance in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by indirect testing for detection of FQ resistance in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture to diagnose TB

detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).5 The test was performed by indirect testing on culture isolates

Reference standard: Culture-based drug susceptibility testing

Studies: Cross-sectional and case-control studies

Sensitivity 0.86 (95% CI: 0.79 to 0.90)

Specificity 0.99 (95% CI: 0.97 to 0.99)

Prevalences 5% 10% 15%

Outcome Number of studies

(Number of patients)

Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested Test

accuracy QoE

Risk of bias

Indirectness Inconsistency Imprecision Publication

bias

Pre-test probability of

5%

Pre-test probability of

10%

Pre-test probability of

15%

True positives (patients with FQ resistance)

19 studies 869 patients

cohort & case-control type studies

1

not serious

2

serious 3 serious

4 not serious none 43 (40 to 45) 86 (79 to 90) 128 (119 to

136) ⨁◯◯◯

VERY LOW

False negatives (patients incorrectly classified as not having FQ resistance)

7 (5 to 10) 14 (10 to 21) 22 (14 to 31)

True negatives (patients without FQ resistance)

19 studies 1354 patients

cohort & case-control type studies

1

not serious

2

serious 3 not serious not serious none 937 (921 to

944) 887 (872 to 895)

838 (824 to 845)

⨁⨁◯◯

LOW

False positives (patients incorrectly classified as having FQ resistance)

13 (6 to 29) 13 (5 to 28) 12 (5 to 26)

Page 8: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

8

Footnotes

1. Thirteen studies used a cross-sectional study design and six studies used a case-control design. A sensitivity analysis that only included cross-sectional studies found sensitivity

and specificity estimates similar to those for all studies.

2. The QUADAS-2 tool was used to assess the risk of bias. Fourteen studies used consecutive or random sampling. In 12 studies, the reader of the test was blinded to results of

the reference standard. The majority of studies used critical concentrations for the phenotypic culture-based reference standard that differed from the concentrations

recommended by WHO. The evidence was downgraded by one point.

3. Several studies included patients (such as known drug-susceptible patients) that did not match the review question. Indirectness was considered in the context of other

factors, including the different critical concentrations used for culture-based drug susceptibility testing. The evidence was downgraded by one point.

4. For individual studies, sensitivity estimates ranged from 57% to 100%. Some of the variability in sensitivity might be explained by the use of different drugs, different critical

concentrations, and different types of culture media in the reference standard. However, some of the variability remained unexplained. The evidence was downgraded by one

point.

5. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl (version

1.0). Therefore the findings in this review should be considered applicable to the test.

Page 9: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

9

Table 4. Accuracy of MTBDRsl by indirect testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by indirect testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture

to diagnose TB detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).5 The test was performed by indirect testing on culture isolates

Reference standard: Culture-based drug susceptibility testing

Studies: Cross-sectional and case-control studies

Sensitivity 0.77 (95% CI: 0.63 to 0.86)

Specificity 0.99 (95% CI: 0.97 to 1.00)

Prevalences 5% 10% 15%

Outcome Number of studies

(Number of patients)

Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested Test

accuracy QoE

Risk of bias

Indirectness Inconsistency Imprecision Publication

bias

pre-test probability of

5%

pre-test probability of

10%

pre-test probability of

15%

True positives (patients with SLID resistance )

16 studies 575 patients

cohort & case-control type studies

1

serious 2 serious

3 serious

4 not serious none 38 (32 to 43) 77 (63 to 86) 115 (95 to 129) ⨁◯◯◯

VERY LOW

False negatives (patients incorrectly classified as not having SLID resistance)

12 (7 to 18) 23 (14 to 37) 35 (21 to 55)

True negatives (patients without SLID resistance)

16 studies 1346 patients

cohort & case-control type studies

1

serious 2 serious

3 not serious not serious none 941 (924 to

947) 892 (876 to 897)

842 (827 to 847)

⨁⨁◯◯

LOW

False positives (patients incorrectly classified as having SLID resistance)

9 (3 to 26) 8 (3 to 24) 8 (3 to 23)

Page 10: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

10

Footnotes

1. Ten studies were cross-sectional design and six studies were case-control design. A sensitivity analysis that only included cross-sectional studies found sensitivity and

specificity estimates similar to those for all studies.

2. The QUADAS-2 tool was used to assess the risk of bias. Eleven studies used consecutive or random sampling. In ten studies, the reader of the test was blinded to results of the

reference standard. The majority of studies used critical concentrations for the phenotypic culture-based reference standard that differed from the concentrations

recommended by WHO. The evidence was downgraded by one point.

3. Several studies included patients (drug-susceptible) that did not match the review question. Indirectness was considered in the context of other factors, including the different

critical concentrations used for culture-based drug susceptibility testing. The evidence was downgraded by one point.

4. For individual studies, sensitivity estimates ranged from 25% to 100%. Some of the variability could be explained by the use of different drugs, critical concentrations, and

types of culture media in the reference standard and by presence of the eis mutation in patients from Eastern Europe. eis gene is not targeted by version 1.0 of the test, which

may lead to lower sensitivity among Eastern European strains. However, some of the variability remained unexplained. The evidence was downgraded by one point.

5. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl (version

1.0). Therefore the findings in this review should be considered applicable to the test.

Page 11: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

11

Table 5. Accuracy of MTBDRsl by direct testing for the diagnosis of XDR-TB in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by direct testing for the diagnosis of XDR-TB in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture

to diagnose TB detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).5 The test was performed by indirect testing on culture isolates

Reference standard: Culture-based drug susceptibility testing

Studies: Cross-sectional and case-control studies

Sensitivity 0.69 (95% CI: 0.39 to 0.89)

Specificity 0.99 (95% CI: 0.95 to 0.99)

Prevalences 1% 5% 10%

Outcome Number of studies

(Number of patients)

Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested

Test accuracy QoE Risk of

bias Indirectness Inconsistency Imprecision

Publication bias

Pre-test probability of

1%

Pre-test probability of

5%

Pre-test probability of

10%

True positives (patients with XDR-TB)

6 studies 143 patients

cross-sectional (cohort type accuracy study)

serious 1 not serious

2

not serious 3 serious

4 none 7 (4 to 9) 35 (19 to 45) 69 (39 to 89) ⨁⨁◯◯

LOW

False negatives (patients incorrectly classified as not having XDR-TB)

3 (1 to 6) 15 (5 to 31) 31 (11 to 61)

True negatives (patients without XDR-TB)

6 studies 1277 patients

cross-sectional (cohort type accuracy study)

serious 1 not serious

2

not serious not serious none 980 (941 to 983)

941 (903 to 943)

891 (855 to 894)

⨁⨁⨁◯

MODERATE

False positives (patients incorrectly classified as having XDR-TB)

10 (7 to 49) 9 (7 to 47) 9 (6 to 45)

Page 12: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

12

Footnotes

1. The QUADAS-2 tool was used to assess the risk of bias. All studies used consecutive sampling. In four studies, the reader of the test was blinded to results of the reference

standard and in two studies information about blinding was not reported. The majority of studies used critical concentrations for the phenotypic culture-based reference

standard that differed from the concentrations recommended by WHO. The evidence was downgraded by one point.

2. There was low concern for applicability. Given the test's high specificity and ability to provide results within a matter of days, the test might improve patient outcomes by

enabling earlier initiation of appropriate therapy. The evidence was not downgraded.

3. For individual studies, sensitivity estimates ranged from 14% to 92%. We thought variability could be explained in part by the use of different drugs, critical concentrations,

and types of culture media in the reference standard and likely presence of eis mutation in patients in Eastern European countries. The evidence was not downgrade and

considered this in the context of other factors, in particular imprecision.

4. The very wide 95% CI for true positives and false negatives may lead to different decisions depending on which confidence limits are assumed. The evidence was downgraded

by one point.

5. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl (version

1.0). Therefore the findings in this review should be considered applicable to the test.

Page 13: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

13

Table 6. Accuracy of MTBDRsl by indirect testing for the diagnosis of XDR-TB in patients with rifampicin-resistant or MDR-TB

Question: What is the diagnostic accuracy of MTBDRsl by indirect testing for the diagnosis of XDR-TB in patients with rifampicin-resistant or MDR-TB?

Participants: patients with rifampicin-resistant or MDR-TB

Prior testing: Patients who received MTBDRsl testing will first have received smear microscopy, Xpert MTB/RIF or other nucleic acid amplification test, and culture

to diagnose TB detection and Xpert MTB/RIF, MTBDRplus (version 2.0) or an alternative line-probe assay to detect first-line drug resistance

Role: Replacement test for culture-based drug susceptibility testing

Settings: Intermediate or central level laboratories

Index (new) test: MTBDRsl (version 1.0).6 The test was performed by indirect testing on culture isolates

Reference standard: Culture-based drug susceptibility testing

Studies: Cross-sectional and case-control studies

Sensitivity 0.69 (95% CI: 0.39 to 0.89)

Specificity 0.99 (95% CI: 0.95 to 0.99)

Prevalences 1% 5% 10%

Outcome № of studies (№

of patients) Study design

Factors that may decrease quality of evidence Effect per 1000 patients tested Test

accuracy QoE

Risk of bias

Indirectness Inconsistency Imprecision Publication

bias

pre-test probability of

1%

pre-test probability of

5%

pre-test probability of

10%

True positives (patients with XDR-TB)

8 studies 173 patients

cohort & case-control type studies

1

serious 2 serious

3 serious

4 not serious

5

none 7 (4 to 9) 35 (19 to 45) 69 (39 to 89) ⨁◯◯◯

VERY LOW

False negatives (patients incorrectly classified as not having XDR-TB)

3 (1 to 6) 15 (5 to 31) 31 (11 to 61)

True negatives (patients without XDR-TB)

8 studies 707 patients

cohort & case-control type studies

1

serious 2 serious

3 not serious

4 not serious none 980 (941 to

983) 941 (903 to 943)

891 (855 to 894) ⨁⨁◯◯

LOW

False positives (patients incorrectly classified as having XDR-TB)

10 (7 to 49) 9 (7 to 47) 9 (6 to 45)

Page 14: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

14

Footnotes

1. Four studies were cross-sectional design and four were case-control design.

2. The QUADAS-2 tool was used to assess the risk of bias. Six studies used consecutive sampling. In six studies, the reader of the test was blinded to results of the reference

standard. All studies used critical concentrations for the phenotypic culture-based reference standard that differed from the concentrations recommended by WHO. The

evidence was downgraded one point.

3. Several studies included patients (drug-susceptible) that did not match the review question. Indirectness was considered in the context of other factors, including the

different critical concentrations used for culture-based drug susceptibility testing. The evidence was downgraded one point.

4. For individual studies, sensitivity estimates ranged from 20% to 100%. Some of the variability could be explained by the use of different drugs, critical concentrations, and

types of culture media in the reference standard and by presence of the eis mutation in patients in Eastern Europe. eis gene is not targeted by version 1.0 of the test,

which may lead to lower sensitivity in Eastern European strains. However, some of the variability remained unexplained. The evidence was downgraded one point.

5. The wide confidence interval around true positives and false negatives may lead to different decisions depending on which confidence limits are assumed. The evidence

was not further downgraded as one point was deducted for inconsistency.

6. This systematic review mainly evaluated MTBDRsl (version 1.0), which has recently been replaced with version 2.0. The addition of new probes targeting more known

resistance-conferring mutations in the MTBDRsl (version 2.0) would be expected to yield a diagnostic accuracy at least the same as or higher than that of MTBDRsl

(version 1.0). Therefore the findings in this review should be considered applicable to the test.

Page 15: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

15 | P a g e

Annex 6. Evidence to recommendations Table 1: Evidence to recommendation: Accuracy of MTBDRsl by direct testing for detection of fluoroquinolone resistance in patients with rifampicin-resistant or

MDR-TB

JUDGEMENT RESEARCH EVIDENCE

ADDITIONAL

CONSIDERATIONS

PROBLEM

Is the problem a priority? ○ No ○ Probably no ○ Probably yes

● Yes ○ Varies

○ Don't know

In 2014 WHO has estimated that 9.7% of the 480,000 cases of MDR-TB , were actually XDR TB, i.e. MDR TB

with added resistance to at least one FQ and one SLID. Genotypic (molecular) methods have considerable advantages for scaling up programmatic management and surveillance of drug-resistant TB, offering speed of diagnosis, standardised testing, potential for high through-put, and fewer requirements for laboratory biosafety. Molecular tests for detecting drug resistance such as the MTBDRsl assay have shown promise for the diagnosis of drug-resistant tuberculosis (TB).

The MTBDRsl assay incorporates probes to detect mutations within genes (gyrA and rrs for version 1.0 and, in addition, gyrB and the eis promoter for version 2.0), which are associated with resistance to the class of fluoroquinolones or the class of second-line injectable drugs (SLID).

Additional regions

associated with resistance to FQ and SLIDs are included in the version 2.0 assay. Accuracy of version 2.0 assay is expected to be no worse than

version 1.0 and should have improved sensitivity for detection of resistance for these drug classes.

TEST ACCURACY

How accurate is the test? ○ Very inaccurate

○ Inaccurate ○ Accurate ○ Very accurate

● Varies ○ Don't know

In this review – data from the 9 studies, 1771 patients, reference standard: culture based DST

Test accuracy MTBDRsl by direct testing for fluoroquinolones: Sensitivity: 86% (95% CI: 75% to 93%) Specificity: 99% (95% CI: 97% to 99%)

More data is needed to better understand the correlation of the presence of certain fluoroquinolone resistance conferring mutations with phenotypic DST resistance for moxifloxacin and patient outcomes.

The presence of mutations in these

regions does not necessarily imply resistance to all the drugs within that class. Although specific mutations within these regions

may be associated with different levels of resistance to each drug within these classes, the extent of this is not completely understood.

Page 16: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

16 | P a g e

DESIRABLE EFFECTS How substantial are the

desirable anticipated effects? ○ Trivial

○ Small ○ Moderate

● Large ○ Varies ○ Don't know

The anticipated desirable effect is the correct diagnosis of fluoroquinolone (FQ) resistant cases (TP) as well as FQ susceptible cases (TN). MTBDRsl would correctly identify 43 cases out of 50 per 1000 individuals

tested if the pre-test probability of TB with FQ resistance is 5%. For 10-15% there would be 86 and 129 patients respectively (see table below). Correct identification of FQ resistant cases should lead to higher cure rates, less sequelae to the individual patient, and less transmission in the community.

Similarly MTBDRsl would correctly identify 937 FQ-susceptible (TN) out of 950 per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%. For 10-15% prevalence’s there would be 887 and 838 patients respectively (see table below). Correct identification of FQ susceptible cases should lead to avoiding unnecessary treatment with additional drugs with increased risk of severe adverse events and greater costs.

The anticipated undesirable effect is the incorrect identification of an individual as a FQ susceptible or FQ resistant case (FN or FP). MTBDRsl would misclassify 7 cases as FN per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%, and 14 to 21 cases under pre-test probabilities of 10-15%. Incorrect identification of an individual as FQ susceptible may have a potential increased risk of patient morbidity and mortality, continued risk of community transmission of drug-resistant TB. However, the harm may be lessened as patients without resistance detected to fluoroquinolones may be

eligible for an MDR-TB regimen which would include either moxifloxacin or gatifloxacin.

MTBDRsl had misclassified 13 cases as FP per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%, and 13 to 12 cases under pre-test probabilities of 10-15%. Incorrect identification of an individual as FQ resistant may lead to patient anxiety, possible delays in further diagnostic evaluation, prolonged and unnecessary treatment with drugs that may have additional serious adverse effects.

Should MTBDRsl by direct testing be used to diagnose FQ resistance in patients with RR or MDR TB?

Test result

Number of results per 1000 patients

tested (95% CI) Number of

participants

(studies)

Quality of the

Evidence (GRADE) Prevalence

5%

Prevalence

10%

Prevalence

15%

True positives

(patients with FQ resistance )

43 (37 to 47)

86 (75 to 93)

129 (112 to 140)

519

(9)

⨁⨁⨁◯ MODERATE

False negatives

(patients incorrectly classified as not having FQ resistance )

7 (3 to 13) 14 (7 to 25) 21 (10 to

38)

Desirable anticipated effects

MTBDRsl can be performed in a single day to allow the initiation of an appropriate treatment regimen. Phenotypic

DST more difficult to

perform.

UNDESIRABLE EFFECTS

How substantial are the undesirable anticipated effects? ○ Large

● Moderate ○ Small ○ Trivial

○ Varies ○ Don't know

Undesirable anticipated effects per drug: FN results are of main concern as patients may not be given an

effective treatment regimen. Less concern for FP results. Conventional phenotypic DST should be used in the

follow-up evaluation of patients with a negative result especially in settings with a high pre-test probability for resistance to

fluoroquinolones. Two GDG members

thought that the undesirable effects were large. Physicians should

be guided by the MTBDRsl assay in their initial choice of an MDR-TB treatment regimen.

Page 17: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

17 | P a g e

True negatives

(patients without FQ

resistance )

937 (921 to

944)

887 (872 to

895)

838 (824 to

845)

1252

(9)

⨁⨁⨁⨁

HIGH

False positives

(patients incorrectly classified

as having FQ resistance )

13 (6 to 29) 13 (5 to 28) 12 (5 to 26)

Implications for the detection of FQ conferring mutations among RR-TB persons

TP: Test result suggests modification of a WHO recommended MDR-TB regimen. No additional harms. Patient receive optimal regimen. FP: Test result suggests modification of a WHO recommended MDR-TB regimen. Increased risk of serious

adverse effects. Patient receive optimal regimen. FN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. Patient receive

suboptimal regimen. No benefits. TN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. No additional harms. Patient receive optimal regimen.

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

What is the overall certainty of the evidence of test accuracy?

○ Very low ○ Low ● Moderate ○ High ○ No included studies

In this review the risk of bias was not serious

Indirectness was considered not serious

Inconsistency was considered serious for test sensitivity and not serious for test specificity

Imprecision was considered not serious for both sensitivity and specificity

Publication bias – none for all studies.

Quality of evidence for test accuracy is: Sensitivity –moderate quality of evidence Specificity – high

quality of evidence

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

What is the overall certainty of

the evidence for any critical or important direct benefits, adverse effects or burden of the test? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

The test is labour-intensive and presents certain burden for the health worker. There is a need for

appropriate infrastructure with separate rooms and biosafety requirements, which assumes a considerable investment. The burden and adverse effects are potentially insignificant for the patient.

CE

OF

M A NWhat is the overall certainty if Ideally test results should guide management decisions, provided use of test is adopted by national policy. A

Page 18: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

18 | P a g e

the evidence of effects of the management that is guided by

the test results? ○ Very low

○ Low ○ Moderate ○ High

● No included studies

positive test result should be sufficient for a patient to start treatment.

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/M

ANAGEMENT

How certain is the link between test results and management decisions? ○ Very low ○ Low ○ Moderate ○ High

● No included studies

The link between test results and management decisions may be uncertain in various settings. In some occasions clinicians use empirical treatment for TB. In others capacity of health system may be insufficient to provide the patient with necessary treatment.

Turnaround time would be faster than for conventional DST

The need for sample referral may cause delays

CERTAINTY OF EFFECTS

What is the overall certainty of the evidence of effects of the test? ○ Very low

○ Low

● Moderate ○ High

○ No included studies

This question is intended to summarize previous four questions on the certainty of the evidence.

VALUES

Is there important uncertainty about or variability in how much people value the main outcomes? ○ Important uncertainty or

variability ○ Possibly important uncertainty or

variability ● Probably no important uncertainty or variability ○ No important uncertainty or

variability ○ No known undesirable outcomes

There is no important uncertainty about or variability in how much people value the main outcomes.

Page 19: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

19 | P a g e

BALANCE OF EFFECTS

Does the balance between desirable and undesirable

effects favor the intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ● Probably favors the intervention ○ Favors the intervention

○ Varies ○ Don't know

FN results increase with increasing pre-test probability for FQ resistance. Conventional phenotypic DST should be used in the follow-up evaluation of patients with a negative result especially in settings with a high

pre-test probability for resistance to fluoroquinolones.

RESOURCES REQUIRED

How large are the resource requirements (costs)? ○ Large costs ○ Moderate costs

○ Negligible costs and savings ○ Moderate savings ○ Large savings

○ Varies

● Don't know

No research evidence was identified.

CERTAINTY OF EVIDENCE OF

REQUIRED RESOURCES

What is the certainty of the evidence of resource requirements (costs)? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

No research evidence was identified.

Page 20: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

20 | P a g e

COST EFFECTIVENESS

Does the cost-effectiveness of the intervention favor the

intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ○ Probably favors the intervention ○ Favors the intervention

○ Varies

● No included studies

No research evidence was identified.

EQUITY

What would be the impact on health equity? ○ Reduced ○ Probably reduced ○ Probably no impact

● Probably increased ○ Increased

○ Varies ○ Don't know

System incorporating molecular methods provides more equity.

ACCEPTABILITY

Is the intervention acceptable to

key stakeholders? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies

○ Don't know

The test may be acceptable to be implemented in reference settings, where infrastructure and qualified staff

to perform MTBDRsl exist. If MTBDRsl is implemented for first-line DST the MTBDRsl assay could be performed on the same specimen for rifampicin-resistant TB or MDR-TB cases.

FEASIBILITY

Is the intervention feasible to implement? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies ○ Don't know

Implementation of the test would require additional funding and technical support for the infrastructure upgrade, training of staff and procuring the equipment.

Page 21: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

21 | P a g e

Summary of judgments

JUDGEMENT IMPLICATIONS

PROBLEM No Probably no Probably yes Yes

Varies Don't know

TEST ACCURACY Very inaccurate Inaccurate Accurate Very accurate

Varies Don't know

DESIRABLE EFFECTS Trivial Small Moderate Large

Varies Don't know

UNDESIRABLE

EFFECTS Large Moderate Small Trivial

Varies Don't know

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/MANAGEMENT

Very low Low Moderate High

No included studies

CERTAINTY OF

EFFECTS Very low Low Moderate High

No included studies

VALUES

Important uncertainty or variability

Possibly important

uncertainty or variability

Probably no important

uncertainty or variability

No important uncertainty or variability

No known undesirable outcomes

BALANCE OF EFFECTS Favors the comparison

Probably favors the comparison

Does not favor either the

Probably favors the

Favors the intervention

Varies Don't know

Page 22: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

22 | P a g e

JUDGEMENT IMPLICATIONS

intervention or the comparison

intervention

RESOURCES

REQUIRED Large costs Moderate costs

Negligible costs and savings

Moderate savings Large savings Varies Don't know

CERTAINTY OF

EVIDENCE OF

REQUIRED

RESOURCES

Very low Low Moderate High

No included studies

COST EFFECTIVENESS Favors the comparison

Probably favors the comparison

Does not favor either the

intervention or the comparison

Probably favors the intervention

Favors the intervention

Varies No included

studies

EQUITY Reduced Probably reduced

Probably no impact

Probably increased

Increased Varies Don't know

ACCEPTABILITY No Probably no Probably yes Yes

Varies Don't know

FEASIBILITY No Probably no Probably yes Yes

Varies Don't know

Conclusions

Should MTBDRsl by direct testing be used to diagnose FQ resistance in patients with RR or MDR TB?

TYPE OF RECOMMENDATION

Strong recommendation against the intervention

Conditional recommendation against

the intervention

Conditional recommendation for either the intervention or the

comparison

Conditional recommendation for the

intervention

Strong recommendation for the intervention

○ ○ ○ ● ○

RECOMMENDATION For patients with confirmed rifampicin-resistant TB or MDR-TB, the WHO guideline development group suggests using direct testing of patient specimens with the MTBDRsl assay as the initial test, over culture and phenotypic DST, to detect resistance to FQ (Conditional recommendation, Moderate certainty in the evidence for test accuracy).

JUSTIFICATION

SUBGROUP Accuracy of version 2.0 assay is expected to be no worse than version 1.0 and should have improved sensitivity for detection of resistance for these

Page 23: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

23 | P a g e

CONSIDERATIONS drug classes.

IMPLEMENTATION CONSIDERATIONS

Adoption of the MTBDRsl assay does not eliminate the need for conventional culture and DST capability. Despite good specificity of the MTBDRsl for the detection of resistance to FQs, culture and phenotypic DST is required to completely exclude resistance to this drug class. However, the demand for

conventional culture and DST capacity may change, based on the prevalence of resistance to second-line anti-TB drugs in patients with confirmed RR-TB or MDR-TB. The following implementation considerations apply:

• MTBDRsl cannot determine resistance to individual drugs in the class of fluoroquinolones. Phenotypic resistance to ofloxacin and levofloxacin is highly correlated with resistance conferring mutations detected by the MTBDRsl assay. Uncertainty remains about the susceptibility to moxifloxacin and gatifloxacin for such strains with mutations;

• MTBDRsl assay should be used in the direct testing of sputum samples irrespective of whether samples are smear-negative or smear-positive from patients with confirmed rifampicin-resistant TB or MDR-TB;

• MTBDRsl assay is designed to TB and resistance to second-line injectable drugs from processed sputum samples. Other respiratory samples (e.g. bronchoalveolar lavage and gastric aspirates) or extrapulmonary samples (tissue samples, CSF or other body fluids) have not been adequately evaluated;

• Culture and phenotypic DST plays a critical role in the monitoring of patients’ response to treatment and for detecting additional resistance to second-line drugs during treatment. Patients with false negative resistance results using the MTBDRsl can be identified and captured through treatment monitoring. Patients with false positive results might benefit from the addition of other drugs;

• The availability of additional second-line drugs is critical.

MONITORING AND

EVALUATION

System of quality assurance is necessary.

RESEARCH PRIORITIES

Current recommendations on the MTBDRsl assay should not prevent or restrict further research on new rapid molecular DST tests, especially for assays that can be used as close as possible to where patients are initially diagnosed with RR-TB and MDR-TB and where treatment can be initiated. Further operational research on the MTBDRsl test should focus on the following priorities:

• Develop and improved understanding of the correlation between the detection of resistance conferring mutations with phenotypic DST results and patient outcomes;

• Develop improved knowledge of the presence of specific mutations detected with the MTBDRsl assay correlated with MICs for individual drugs within the class of fluoroquinolones;

• Review evidence to confirm or revise different critical concentrations used in phenotypic DST methods; • Determine the limit of detection of MTBDRsl for the detection of heteroresistance; • Determine training, competency, and quality assurance needs; • Gather more evidence on the impact on appropriate MDR-TB treatment initiation and mortality; • Meet “Standards for Reporting Diagnostic accuracy studies” (STARD) for future studies; • Perform country-specific cost-effectiveness and cost-benefit analyses of MTDDRsl assay use in different programmatic settings.

Page 24: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

24 | P a g e

Table 2: Evidence to recommendation: Accuracy of MTBDRsl by direct testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB

JUDGEMENT RESEARCH EVIDENCE

ADDITIONAL

CONSIDERATIONS

PROBLEM

Is the problem a priority? ○ No ○ Probably no ○ Probably yes

● Yes ○ Varies ○ Don't know

In 2014 WHO has estimated that 9.7% of the 480,000 cases of MDR-TB , were actually XDR TB, i.e. MDR TB

with added resistance to at least one FQ and one SLID. Genotypic (molecular) methods have considerable advantages for scaling up programmatic management and surveillance of drug-resistant TB, offering speed of diagnosis, standardised testing, potential for high through-put, and fewer requirements for laboratory biosafety. Molecular tests for detecting drug resistance such as the MTBDRsl assay have shown promise for the diagnosis of drug-resistant tuberculosis (TB).

The MTBDRsl assay incorporates probes to detect mutations within genes (gyrA and rrs for version 1.0 and, in addition, gyrB and the eis promoter for version 2.0), which are associated with resistance to the class of fluoroquinolones or the class of second-line injectable drugs (SLID).

Additional regions

associated with resistance to FQ and SLIDs are included in the version 2.0 assay. Accuracy of version 2.0 assay is expected to be no worse than

version 1.0 and should have improved sensitivity for detection of resistance for these drug classes.

TEST ACCURACY

How accurate is the test? ○ Very inaccurate

○ Inaccurate ○ Accurate

○ Very accurate

● Varies ○ Don't know

In this review – data from the 8 studies, 1639 patients, reference standard: culture based DST

Test accuracy MTBDRsl by direct testing for SLID: Sensitivity: 87% (95% CI: 38% to 99%) Specificity: 99% (95% CI: 94% to 100%)

MTBDRsl by direct testing for Amikacin: Sensitivity: 92% (95% CI: 71% to 98%) Specificity: 100% (95% CI: 95% to 100%) MTBDRsl by direct testing for Kanamycin: Sensitivity: 79% (95% CI: 12% to 99%) Specificity: 100% (95% CI: 94% to 100%) MTBDRsl by direct testing for Capreomycin: Sensitivity: 77% (95% CI: 61% to 87%7) Specificity: 98% (95% CI: 93% to 100%)

The accuracy varies with the different

SLID. The variability is explained in part by the use of different drugs, critical concentrations, types of culture media in the reference

standard and likely presence of eis resistance-conferring mutations in patients in Eastern European countries.

DESIRABLE

EFFECTS

How substantial are the desirable anticipated effects? ○ Trivial ○ Small ○ Moderate

● Large

The anticipated desirable effect is the correct diagnosis of SLID resistant cases (TP) as well as SLID susceptible cases (TN). MTBDRsl would correctly identify 44 cases out of 50 per 1000 individuals tested if the pre-test probability of TB is 5%. For 10-15% there would be 87 and 131 patients respectively (see table below). Correct identification of SLID resistant cases should lead to higher cure rates, less sequelae to the individual patient, and less transmission in the community.

Desirable anticipated effects per drug: Amikacin – Large desirable effects Capreomycin – Large

desirable effects

Page 25: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

25 | P a g e

○ Varies

○ Don't know

Similarly MTBDRsl would correctly identify 945 TB-free cases (TN) out of 950 per 1000 individuals tested if the pre-test probability of TB is 5%. For 10-15% prevalence’s there would be 896 and 846 patients

respectively (see table below). Correct identification of SLID susceptible cases should lead to avoiding unnecessary treatment with additional drugs with increased risk of severe adverse events and greater costs.

The anticipated undesirable effect is the incorrect identification of an individual as a SLID susceptible or resistant case (FN or FP).

MTBDRsl would misclassify 6 cases as FN per 1000 individuals tested if the pre-test probability of TB with SLID resistance is 5%, and 13 to 19 cases under pre-test probabilities of 10-15%. Incorrect identification

of an individual as SLID susceptible may have a potential increased risk of patient morbidity and mortality, and continued risk of community transmission of drug-resistant TB as well initiation of an MDR-TB regimen which includes a SLID with doubtful efficacy.

MTBDRsl had misclassified 5 cases as FP per 1000 individuals tested if the pre-test probability of TB is 5%, and 4 cases under pre-test probabilities of 10-15%. Incorrect identification of an individual as SLID resistant may lead to patient anxiety, possible delays in further diagnostic evaluation, prolonged and unnecessary treatment with drugs that may have additional serious adverse effects.

Should MTBDRsl by direct testing be used to diagnose SLID resistance in patients with RR or MDR TB?

Test result

Number of results per 1000 patients

tested (95% CI) Number of

participants

(studies)

Quality of the

Evidence (GRADE) Prevalence

5%

Prevalence

10%

Prevalence

15%

True positives

(patients with SLID resistance )

44 (19 to 49)

87 (38 to 99)

131 (57 to 148)

348

(8)

⨁⨁◯◯ LOW 1,2,3,4

False negatives

(patients incorrectly classified as not having SLID

resistance )

6 (1 to 31) 13 (1 to 62) 19 (2 to 93)

True negatives

(patients without SLID resistance )

945 (889 to 950)

896 (842 to 900)

846 (796 to 850)

1291

(8)

⨁⨁⨁◯ MODERATE 1,2,5

False positives

(patients incorrectly classified as having SLID resistance )

5 (0 to 61) 4 (0 to 58) 4 (0 to 54)

Kanamycin – Large desirable effects

UNDESIRABLE EFFECTS

How substantial are the undesirable anticipated effects? ○ Large

○ Moderate ○ Small

○ Trivial

● Varies ○ Don't know

Undesirable anticipated effects per drug:

Amikacin – Small undesirable effects Capreomycin and kanamycin – moderate undesirable effects

Two GDG members thought that the undesirable effects were large. Physicians should be guided by the

MTBDRsl assay in

their initial choice of an MDR-TB treatment regimen. Conventional phenotypic DST

should be used in the follow-up evaluation of patients with a negative result especially in settings with a high pre-test probability for

resistance to SLIDs.

Page 26: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

26 | P a g e

Implications for the detection of SLID conferring mutations among RR-TB persons

TP: Test result suggests modification of a WHO recommended MDR-TB regimen. No additional harms.

Patient receive optimal regimen. FP: Test result suggests modification of a WHO recommended MDR-TB regimen. Increased risk of serious adverse effects. Patient receive optimal regimen. FN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. Patient receive suboptimal regimen. No benefits. TN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. No additional harms. Patient receive optimal regimen.

CERTAINTY OF THE EVIDENCE

OF TEST ACCURACY

What is the overall certainty of the evidence of test accuracy?

○ Very low ● Low ○ Moderate ○ High ○ No included studies

In this review the risk of bias was serious

Indirectness was considered not serious

Inconsistency was considered not serious

Imprecision was considered serious for sensitivity and not serious for specificity

Publication bias – none for all studies

Quality of evidence for test accuracy is: Sensitivity –low

quality of evidence Specificity – moderate quality of evidence Kanamycin-low certainty Capreomycin-low certainty

Amikacin – moderate certainty

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

What is the overall certainty of the evidence for any critical or important direct benefits, adverse effects or burden of the test? ○ Very low

○ Low

○ Moderate ○ High

● No included studies

The test is labour-intensive and presents certain burden for the health worker. There is a need for appropriate infrastructure with separate rooms and biosafety requirements, which assumes a considerable investment. The burden and adverse effects are potentially insignificant for the patient.

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S

EFFECTS

What is the overall certainty if the evidence of effects of the management that is guided by the test results? ○ Very low ○ Low ○ Moderate ○ High

Ideally test results should guide management decisions, provided use of test is adopted by national policy. A positive test result should be sufficient for a patient to start treatment.

Page 27: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

27 | P a g e

● No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/M

ANAGEMENT

How certain is the link between test results and management decisions? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

The link between test results and management decisions may be uncertain in various settings. In some occasions clinicians use empirical treatment for TB. In others capacity of health system may be insufficient to provide the patient with necessary treatment.

Turnaround time would be faster than for conventional DST

The need for sample referral may cause delays

CERTAINTY OF EFFECTS

What is the overall certainty of the evidence of effects of the test? ○ Very low

● Low ○ Moderate

○ High

○ No included studies

This question is intended to summarize previous four questions on the certainty of the evidence. Kanamycin and Capreomycin – low certainty

Amikacin – moderate certainty

VALUES

Is there important uncertainty about or variability in how much people value the main outcomes? ○ Important uncertainty or

variability ○ Possibly important uncertainty or

variability ● Probably no important uncertainty or variability ○ No important uncertainty or

variability ○ No known undesirable outcomes

There is no important uncertainty about or variability in how much people value the main outcomes.

Page 28: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

28 | P a g e

BALANCE OF EFFECTS

Does the balance between desirable and undesirable

effects favor the intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ● Probably favors the intervention ○ Favors the intervention

○ Varies ○ Don't know

Desirable (Amikacin, Kanamycin, Capreomycin) - Large, Large, Large

Undesirable (Amikacin, Kanamycin, Capreomycin) - Small, Moderate, Moderate

Concern - FN

Accuracy for

detecting amikacin resistance is better than for capreomycin or kanamycin.

RESOURCES REQUIRED

How large are the resource requirements (costs)? ○ Large costs ○ Moderate costs

○ Negligible costs and savings ○ Moderate savings ○ Large savings

○ Varies

● Don't know

No research evidence was identified.

CERTAINTY OF EVIDENCE OF

REQUIRED RESOURCES

What is the certainty of the evidence of resource requirements (costs)? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

No research evidence was identified.

Page 29: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

29 | P a g e

COST EFFECTIVENESS

Does the cost-effectiveness of the intervention favor the

intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ○ Probably favors the intervention ○ Favors the intervention

○ Varies

● No included studies

No research evidence was identified.

EQUITY

What would be the impact on health equity? ○ Reduced ○ Probably reduced ○ Probably no impact

● Probably increased ○ Increased

○ Varies ○ Don't know

System incorporating molecular methods provides more equity.

ACCEPTABILITY

Is the intervention acceptable to

key stakeholders? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies

○ Don't know

The test may be acceptable to be implemented in reference settings, where infrastructure and qualified staff

to perform MTBDRsl exist. If MTBDRsl is implemented for first-line DST the MTBDRsl assay could be performed on the same sample

FEASIBILITY

Is the intervention feasible to implement? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies ○ Don't know

Implementation of the test would require additional funding and technical support for the infrastructure upgrade, training of staff and procuring the equipment.

Page 30: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

30 | P a g e

Summary of judgments

JUDGEMENT IMPLICATIONS

PROBLEM No Probably no Probably yes Yes

Varies Don't know

TEST ACCURACY Very inaccurate Inaccurate Accurate Very accurate

Varies Don't know

DESIRABLE EFFECTS Trivial Small Moderate Large

Varies Don't know

UNDESIRABLE

EFFECTS Large Moderate Small Trivial

Varies Don't know

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/MANAGEMENT

Very low Low Moderate High

No included studies

CERTAINTY OF

EFFECTS Very low Low Moderate High

No included studies

VALUES

Important uncertainty or variability

Possibly important

uncertainty or variability

Probably no important

uncertainty or variability

No important uncertainty or variability

No known undesirable outcomes

BALANCE OF EFFECTS Favors the Probably favors Does not favor Probably favors Favors the Varies Don't know

Page 31: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

31 | P a g e

JUDGEMENT IMPLICATIONS

comparison the comparison either the intervention or the comparison

the intervention

intervention

RESOURCES

REQUIRED Large costs Moderate costs

Negligible costs and savings

Moderate savings Large savings Varies Don't know

CERTAINTY OF

EVIDENCE OF

REQUIRED

RESOURCES

Very low Low Moderate High

No included studies

COST EFFECTIVENESS Favors the comparison

Probably favors the comparison

Does not favor either the

intervention or the comparison

Probably favors the intervention

Favors the intervention

Varies No included

studies

EQUITY Reduced Probably reduced

Probably no impact

Probably increased

Increased Varies Don't know

ACCEPTABILITY No Probably no Probably yes Yes

Varies Don't know

FEASIBILITY No Probably no Probably yes Yes

Varies Don't know

Conclusions

Should MTBDRsl by direct testing be used to diagnose SLID resistance in patients with RR or MDR TB?

TYPE OF

RECOMMENDATION Strong recommendation against the intervention

Conditional recommendation against

the intervention

Conditional recommendation for either the intervention or the

comparison

Conditional recommendation for the

intervention

Strong recommendation for the intervention

○ ○ ○ ● ○

RECOMMENDATION For patients with confirmed rifampicin-resistant TB or MDR-TB, the WHO guideline development group suggests using direct testing of patient specimens with the MTBDRsl assay as the initial test, over culture and phenotypic DST, to detect resistance to SLID (Conditional recommendation, Low certainty in the evidence for test accuracy).

JUSTIFICATION

Page 32: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

32 | P a g e

SUBGROUP CONSIDERATIONS

Accuracy of version 2.0 assay is expected to be no worse than version 1.0 and should have improved sensitivity for detection of resistance for these drug classes.

IMPLEMENTATION

CONSIDERATIONS

Adoption of the MTBDRsl assay does not eliminate the need for conventional culture and DST capability. Despite good specificity of the MTBDRsl for the

detection of resistance to SLIDs, culture and phenotypic DST is required to completely exclude resistance to these drug classes. However, the demand for conventional culture and DST capacity may change, based on the prevalence of resistance to second-line anti-TB drugs in patients with confirmed RR-TB or MDR-TB. The following implementation considerations apply:

• Mutations in some regions (e.g., the eis promoter region) may be responsible for causing resistance to one drug in a class more than other drugs within that class. The eis C14T mutation is associated with kanamycin resistance in strains from Eastern Europe;

• MTBDRsl assay should be used in the direct testing of sputum samples irrespective of whether samples are smear-negative or smear-positive from patients with confirmed rifampicin-resistant TB or MDR-TB;

• MTBDRsl assay is designed to TB and resistance to second-line injectable drugs from processed sputum samples. Other respiratory samples (e.g. bronchoalveolar lavage and gastric aspirates) or extrapulmonary samples (tissue samples, CSF or other body fluids) have not been adequately evaluated;

• Culture and phenotypic DST plays a critical role in the monitoring of patients’ response to treatment and for detecting additional resistance to second-line drugs during treatment. Patients with false negative resistance results using the MTBDRsl can be identified and captured through treatment monitoring. Patients with false positive results might benefit from the addition of other drugs;

• The availability of additional second-line drugs is critical.

MONITORING AND EVALUATION

System of quality assurance is necessary.

RESEARCH PRIORITIES

Current recommendations on the MTBDRsl assay should not prevent or restrict further research on new rapid molecular DST tests, especially for assays that can be used as close as possible to where patients are initially diagnosed with RR-TB and MDR-TB and where treatment can be initiated. Further operational research on the MTBDRsl test should focus on the following priorities:

• Develop and improved understanding of the correlation between the detection of resistance conferring mutations with phenotypic DST results and patient outcomes;

• Develop improved knowledge of the presence of specific mutations detected with the MTBDRsl assay correlated with MICs for individual drugs

within the class of SLIDs; • Review evidence to confirm or revise different critical concentrations used in phenotypic DST methods; • Determine the limit of detection of MTBDRsl for the detection of heteroresistance; • Determine training, competency, and quality assurance needs; • Gather more evidence on the impact on appropriate MDR-TB treatment initiation and mortality; • Meet “Standards for Reporting Diagnostic accuracy studies” (STARD) for future studies; • Perform country-specific cost-effectiveness and cost-benefit analyses of MTDDRsl assay use in different programmatic settings.

Page 33: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

33 | P a g e

Table 3: Evidence to recommendations: Accuracy of MTBDRsl by indirect testing for detection of fluoroquinolone resistance in patients with rifampicin-resistant

or MDR-TB

JUDGEMENT RESEARCH EVIDENCE

ADDITIONAL

CONSIDERATIONS

PROBLEM

Is the problem a priority? ○ No ○ Probably no ○ Probably yes

● Yes ○ Varies

○ Don't know

In 2014 WHO has estimated that 9.7% of the 480,000 cases of MDR-TB , were actually XDR TB, i.e. MDR TB with added resistance to at least one FQ and one SLID. Genotypic (molecular) methods have considerable advantages for scaling up programmatic management and surveillance of drug-resistant TB, offering speed of diagnosis, standardised testing, potential for high through-put, and fewer requirements for laboratory biosafety. Molecular tests for detecting drug resistance such as the MTBDRsl assay have shown promise for the diagnosis of drug-resistant tuberculosis (TB).

The MTBDRsl assay incorporates probes to detect mutations within genes (gyrA and rrs for version 1.0 and, in addition, gyrB and the eis promoter for version 2.0), which are associated with resistance to the class of fluoroquinolones or the class of second-line injectable drugs (SLID).

Additional regions associated with resistance to FQ and SLIDs are included in the version 2.0 assay. Accuracy of version

2.0 assay is expected to be no worse than version 1.0 and should have improved sensitivity for detection of resistance for these

drug classes.

TEST ACCURACY

How accurate is the test? ○ Very inaccurate ○ Inaccurate

● Accurate ○ Very accurate

○ Varies

○ Don't know

In this review – data from the 19 studies, 2223 patients, reference standard: culture based DST

Test accuracy MTBDRsl by indirect testing for fluoroquinolones: Sensitivity: 86%(95% CI: 79% to 90%) Specificity: 99% (95% CI: 97% to 99%) More data is needed to better understand the correlation of the presence of certain fluoroquinolone resistance conferring mutations with phenotypic DST resistance for moxifloxacin and patient outcomes. The diagnostic accuracy of MTBDRsl is similar when performed using either direct or indirect testing.

The presence of mutations in these regions does not necessarily imply resistance to all the drugs within that class. Although

specific mutations within these regions may be associated with different levels of resistance to each drug within these classes, the extent of

this is not completely understood.

DESIRABLE

EFFECTS How substantial are the

desirable anticipated effects? ○ Trivial ○ Small

● Moderate ○ Large

The anticipated desirable effect is the correct diagnosis of fluoroquinolone (FQ) resistant cases (TP) as well as FQ susceptible cases (TN). MTBDRsl would correctly identify 43 cases out of 50 per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%. For 10-15% there would be 86 and 128 patients respectively (see table below). Correct identification of FQ resistant cases should lead to higher cure rates, less sequelae to the individual patient, and less transmission in the community.

Desirable anticipated effects Indirect testing with MTBDRsl can be performed in a single day once the culture

Page 34: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

34 | P a g e

○ Varies

○ Don't know

Similarly MTBDRsl would correctly identify 937 FQ-susceptible (TN) out of 950 per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%. For 10-15% prevalence’s there would be 887 and

838 patients respectively (see table below). Correct identification of FQ susceptible cases should lead to avoiding unnecessary treatment with additional drugs with increased risk of severe adverse events and greater costs.

The anticipated undesirable effect is the incorrect identification of an individual as a FQ susceptible or FQ resistant case (FN or FP).

MTBDRsl would misclassify 7 cases as FN per 1000 individuals tested if the pre-test probability of TB with FQ resistance is 5%, and 14 to 22 cases under pre-test probabilities of 10-15%. Incorrect identification of an

individual as FQ susceptible may have a potential increased risk of patient morbidity and mortality, continued risk of community transmission of drug-resistant TB. However, the harm may be lessened as patients without resistance detected to fluoroquinolones may be eligible for an MDR-TB

regimen which would include either moxifloxacin or gatifloxacin.

MTBDRsl had misclassified 13 cases as FP per 1000 individuals tested if the pre-test probability of TB with FQ

resistance is 5%, and 13 to 12 cases under pre-test probabilities of 10-15%. Incorrect identification of an

individual as FQ resistant may lead to patient anxiety, possible delays in further diagnostic evaluation, prolonged and unnecessary treatment with drugs that may have additional serious adverse effects. Should MTBDRsl by indirect testing be used to diagnose FQ resistance in patients with RR or MDR TB?

Test result

Number of results per 1000 patients

tested (95% CI) Number of

participants

(studies)

Quality of the

Evidence (GRADE) Prevalence

5%

Prevalence

10%

Prevalence

15%

True positives

(patients with FQ resistance )

43 (40 to

45)

86 (79 to

90)

128 (119 to

133)

869

(19)

⨁◯◯◯ VERY LOW

False negatives (patients incorrectly classified

as not having FQ resistance )

7 (5 to 10) 14 (10 to

21)

22 (14 to

31)

True negatives (patients without FQ

resistance )

937 (921 to 944)

887 (872 to 895)

838 (824 to 845)

1354 (19)

⨁⨁◯◯ LOW

False positives

(patients incorrectly classified as having FQ resistance )

13 (6 to 29) 13 (5 to 28) 12 (5 to 26)

is grown. The method is faster and easier to

perform than phenotypic DST.

UNDESIRABLE EFFECTS

How substantial are the undesirable anticipated effects? ○ Large

● Moderate ○ Small ○ Trivial

○ Varies ○ Don't know

Undesirable anticipated effects per drug:

FN results are of main concern as patients may not be given an effective treatment regimen. Less concern for FP results.

Conventional phenotypic DST should be used in the follow-up evaluation of patients with a negative result

especially in settings

with a high pre-test probability for resistance to fluoroquinolones.

Page 35: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

35 | P a g e

Implications for the detection of FQ conferring mutations among RR-TB persons

TP: Test result suggests modification of a WHO recommended MDR-TB regimen. No additional harms.

Patient receive optimal regimen. FP: Test result suggests modification of a WHO recommended MDR-TB regimen. Increased risk of serious adverse effects. Patient receive optimal regimen. FN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. Patient receive suboptimal regimen. No benefits. TN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. No additional harms. Patient receive optimal regimen.

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

What is the overall certainty of the evidence of test accuracy?

● Very low ○ Low ○ Moderate ○ High ○ No included studies

In this review the risk of bias was serious

Indirectness was considered serious

Inconsistency was considered serious for test sensitivity and not serious for test specificity

Imprecision was considered not serious for sensitivity and specificity

Publication bias – none for all studies.

Quality of evidence for test accuracy is: Sensitivity – very low

quality of evidence Specificity – low quality of evidence

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

What is the overall certainty of the evidence for any critical or important direct benefits, adverse effects or burden of the test? ○ Very low

○ Low ○ Moderate ○ High

● No included studies

The test is labour-intensive and presents certain burden for the health worker. There is a need for appropriate infrastructure with separate rooms and biosafety requirements, which assumes a considerable investment. The burden and adverse effects are potentially insignificant for the patient.

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S EFFECTS

What is the overall certainty if the evidence of effects of the management that is guided by the test results? ○ Very low ○ Low ○ Moderate

○ High

● No included studies

Ideally test results should guide management decisions, provided use of test is adopted by national policy. A positive test result should be sufficient for a patient to start treatment.

Page 36: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

36 | P a g e

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/M

ANAGEMENT

How certain is the link between test results and management

decisions? ○ Very low ○ Low ○ Moderate

○ High

● No included studies

The link between test results and management decisions may be uncertain in various settings. In some occasions clinicians use empirical treatment for TB. In others capacity of health system may be insufficient to

provide the patient with necessary treatment.

Turnaround time would be faster than for conventional DST

The need for sample referral may cause delays

CERTAINTY OF EFFECTS

What is the overall certainty of

the evidence of effects of the test? ○ Very low ○ Low

● Moderate ○ High

○ No included studies

This question is intended to summarize previous four questions on the certainty of the evidence.

VALUES

Is there important uncertainty about or variability in how much people value the main outcomes? ○ Important uncertainty or

variability ○ Possibly important uncertainty or

variability

● Probably no important uncertainty

or variability ○ No important uncertainty or

variability ○ No known undesirable outcomes

There is no important uncertainty about or variability in how much people value the main outcomes.

Page 37: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

37 | P a g e

BALANCE OF EFFECTS

Does the balance between desirable and undesirable

effects favor the intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ● Probably favors the intervention ○ Favors the intervention

○ Varies ○ Don't know

FN results increase with increasing pre-test probability for FQ resistance. Conventional phenotypic DST should be used in the follow-up evaluation of patients with a negative result especially in settings with a high

pre-test probability for resistance to fluoroquinolones.

RESOURCES REQUIRED

How large are the resource requirements (costs)? ○ Large costs ○ Moderate costs

○ Negligible costs and savings ○ Moderate savings ○ Large savings

○ Varies

● Don't know

No research evidence was identified.

CERTAINTY OF EVIDENCE OF

REQUIRED RESOURCES

What is the certainty of the evidence of resource requirements (costs)? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

No research evidence was identified.

Page 38: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

38 | P a g e

COST EFFECTIVENESS

Does the cost-effectiveness of the intervention favor the

intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ○ Probably favors the intervention ○ Favors the intervention

○ Varies

● No included studies

No research evidence was identified.

EQUITY

What would be the impact on health equity? ○ Reduced ○ Probably reduced ○ Probably no impact

● Probably increased ○ Increased

○ Varies ○ Don't know

System incorporating molecular methods provides more equity.

ACCEPTABILITY

Is the intervention acceptable to

key stakeholders? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies

○ Don't know

The test may be acceptable to be implemented in reference settings, where infrastructure and qualified staff

to perform MTBDRsl exist. If MTBDRsl is implemented for first-line DST the MTBDRsl assay could be performed on the same specimen for rifampicin-resistant TB or MDR-TB cases.

FEASIBILITY

Is the intervention feasible to implement? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies ○ Don't know

Implementation of the test would require additional funding and technical support for the infrastructure upgrade, training of staff and procuring the equipment.

Page 39: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

39 | P a g e

Summary of judgments

JUDGEMENT IMPLICATIONS

PROBLEM No Probably no Probably yes Yes

Varies Don't know

TEST ACCURACY Very inaccurate Inaccurate Accurate Very accurate

Varies Don't know

DESIRABLE EFFECTS Trivial Small Moderate Large

Varies Don't know

UNDESIRABLE

EFFECTS Large Moderate Small Trivial

Varies Don't know

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

Very low Low Moderate High

No included

studies

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/MANAGEMENT

Very low Low Moderate High

No included studies

CERTAINTY OF

EFFECTS Very low Low Moderate High

No included

studies

VALUES

Important

uncertainty or variability

Possibly important

uncertainty or variability

Probably no important

uncertainty or variability

No important

uncertainty or variability

No known

undesirable outcomes

BALANCE OF EFFECTS Favors the comparison

Probably favors the comparison

Does not favor either the

Probably favors the

Favors the intervention

Varies Don't know

Page 40: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

40 | P a g e

JUDGEMENT IMPLICATIONS

intervention or the comparison

intervention

RESOURCES

REQUIRED Large costs Moderate costs

Negligible costs and savings

Moderate savings Large savings Varies Don't know

CERTAINTY OF

EVIDENCE OF

REQUIRED

RESOURCES

Very low Low Moderate High

No included studies

COST EFFECTIVENESS Favors the comparison

Probably favors the comparison

Does not favor either the

intervention or the comparison

Probably favors the intervention

Favors the intervention

Varies No included

studies

EQUITY Reduced Probably reduced

Probably no impact

Probably increased

Increased Varies Don't know

ACCEPTABILITY No Probably no Probably yes Yes

Varies Don't know

FEASIBILITY No Probably no Probably yes Yes

Varies Don't know

Conclusions

Should MTBDRsl by direct testing be used to diagnose FQ resistance in patients with RR or MDR TB?

TYPE OF RECOMMENDATION

Strong recommendation against the intervention

Conditional recommendation against

the intervention

Conditional recommendation for either the intervention or the

comparison

Conditional recommendation for the

intervention

Strong recommendation for the intervention

○ ○ ○ ● ○

RECOMMENDATION For patients with confirmed rifampicin-resistant TB or MDR-TB, the WHO guideline development group suggests using indirect testing of cultured

isolates of M.tuberculosis with the MTBDRsl assay as the initial test, over culture and phenotypic DST, to detect resistance to FQ (Conditional recommendation, Very low certainty in the evidence for test accuracy).

JUSTIFICATION

SUBGROUP Accuracy of version 2.0 assay is expected to be no worse than version 1.0 and should have improved sensitivity for detection of resistance for these

Page 41: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

41 | P a g e

CONSIDERATIONS drug classes.

IMPLEMENTATION CONSIDERATIONS

Adoption of the MTBDRsl assay does not eliminate the need for conventional culture and DST capability. Despite good specificity of the MTBDRsl for the detection of resistance to FQs, culture and phenotypic DST is required to completely exclude resistance to this drug class. However, the demand for

conventional culture and DST capacity may change, based on the prevalence of resistance to second-line anti-TB drugs in patients with confirmed RR-TB or MDR-TB. The following implementation considerations apply:

• MTBDRsl cannot determine resistance to individual drugs in the class of fluoroquinolones. Phenotypic resistance to ofloxacin and levofloxacin is highly correlated with resistance conferring mutations detected by the MTBDRsl assay. Uncertainty remains about the susceptibility to moxifloxacin and gatifloxacin for such strains with mutations;

• Culture and phenotypic DST plays a critical role in the monitoring of patients’ response to treatment and for detecting additional resistance to second-line drugs during treatment. Patients with false negative resistance results using the MTBDRsl can be identified and captured through

treatment monitoring. Patients with false positive results might benefit from the addition of other drugs; • The availability of additional second-line drugs is critical.

MONITORING AND EVALUATION

System of quality assurance is necessary.

RESEARCH PRIORITIES

Current recommendations on the MTBDRsl assay should not prevent or restrict further research on new rapid molecular DST tests, especially for assays that can be used as close as possible to where patients are initially diagnosed with RR-TB and MDR-TB and where treatment can be initiated. Further operational research on the MTBDRsl test should focus on the following priorities:

• Develop and improved understanding of the correlation between the detection of resistance conferring mutations with phenotypic DST results

and patient outcomes; • Develop improved knowledge of the presence of specific mutations detected with the MTBDRsl assay correlated with MICs for individual drugs

within the class of fluoroquinolones; • Review evidence to confirm or revise different critical concentrations used in phenotypic DST methods; • Determine the limit of detection of MTBDRsl for the detection of heteroresistance; • Determine training, competency, and quality assurance needs; • Gather more evidence on the impact on appropriate MDR-TB treatment initiation and mortality;

• Meet “Standards for Reporting Diagnostic accuracy studies” (STARD) for future studies; • Perform country-specific cost-effectiveness and cost-benefit analyses of MTDDRsl assay use in different programmatic settings.

Page 42: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

42 | P a g e

Table 4: Accuracy of MTBDRsl by indirect testing for detection of SLID resistance in patients with rifampicin-resistant or MDR-TB

JUDGEMENT RESEARCH EVIDENCE

ADDITIONAL

CONSIDERATIONS

PROBLEM

Is the problem a priority? ○ No ○ Probably no ○ Probably yes

● Yes ○ Varies ○ Don't know

In 2014 WHO has estimated that 9.7% of the 480,000 cases of MDR-TB , were actually XDR TB, i.e. MDR TB

with added resistance to at least one FQ and one SLID. Genotypic (molecular) methods have considerable advantages for scaling up programmatic management and surveillance of drug-resistant TB, offering speed of diagnosis, standardised testing, potential for high through-put, and fewer requirements for laboratory biosafety. Molecular tests for detecting drug resistance such as the MTBDRsl assay have shown promise for the diagnosis of drug-resistant tuberculosis (TB).

The MTBDRsl assay incorporates probes to detect mutations within genes (gyrA and rrs for version 1.0 and, in addition, gyrB and the eis promoter for version 2.0), which are associated with resistance to the class of fluoroquinolones or the class of second-line injectable drugs (SLID).

Additional regions

associated with resistance to FQ and SLIDs are included in the version 2.0 assay. Accuracy of version 2.0 assay is expected to be no worse than

version 1.0 and should have improved sensitivity for detection of resistance for these drug classes.

TEST ACCURACY

How accurate is the test? ○ Very inaccurate

○ Inaccurate ○ Accurate

○ Very accurate

● Varies ○ Don't know

In this review – data from the 16 studies, 1921 patients, reference standard: culture based DST

Test accuracy MTBDRsl by direct testing for SLID: Sensitivity: 76.5% (95% CI: 63.3% to 86.0%) Specificity: 99.1% (95% CI: 97.3% to 99.7%)

MTBDRsl by direct testing for Amikacin: Sensitivity: 84.9% (95% CI: 79.2% to 89.1%) Specificity: 99.1% (95% CI: 97.6% to 99.6%) MTBDRsl by direct testing for Kanamycin: Sensitivity: 66.9% (95% CI: 44.1% to 83.8%) Specificity: 98.6% (95% CI: 96.1% to 99.5%) MTBDRsl by direct testing for Capreomycin: Sensitivity: 79.5% (95% CI: 58.3% to 91.4%) Specificity: 95.8% (95% CI: 93.4% to 97.3%)

The accuracy varies with the different

SLID. The variability is explained in part by the use of different drugs, critical concentrations, types of culture media in the reference

standard and likely presence of eis resistance-conferring mutations in patients in Eastern European countries.

DESIRABLE

EFFECTS

How substantial are the desirable anticipated effects? ○ Trivial ○ Small ○ Moderate

● Large

The anticipated desirable effect is the correct diagnosis of SLID resistant cases (TP) as well as SLID susceptible cases (TN). MTBDRsl would correctly identify 32 cases out of 50 per 1000 individuals tested if the pre-test probability of TB is 5%. For 10-15% there would be 77 and 115 patients respectively (see table below). Correct identification of SLID resistant cases should lead to higher cure rates, less sequelae to the individual patient, and less transmission in the community.

Desirable anticipated effects per drug: Amikacin – Large desirable effects Capreomycin – Large

desirable effects

Page 43: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

43 | P a g e

○ Varies

○ Don't know

Similarly MTBDRsl would correctly identify 941 TB cases susceptible to SLID (TN) out of 950 per 1000 individuals tested if the pre-test probability of TB is 5%. For 10-15% prevalence’s there would be 896 and

846 patients respectively (see table below). Correct identification of SLID susceptible cases should lead to avoiding unnecessary treatment with additional drugs with increased risk of severe adverse events and greater costs.

The anticipated undesirable effect is the incorrect identification of an individual as a SLID susceptible or resistant case (FN or FP).

MTBDRsl would misclassify 12 cases as FN per 1000 individuals tested if the pre-test probability of TB with SLID resistance is 5%, and 23 to 35 cases under pre-test probabilities of 10-15%. Incorrect identification

of an individual as SLID susceptible may have a potential increased risk of patient morbidity and mortality, and continued risk of community transmission of drug-resistant TB as well initiation of an MDR-TB regimen which includes a SLID with doubtful efficacy.MTBDRsl had misclassified 9 cases as FP per 1000 individuals tested if the pre-test probability of TB with re

sistance to SLID is 5%, and 8 cases under pre-test probabilities of 10-15%. Incorrect identification of an individual as SLID resistant may lead to patient anxiety, possible delays in further diagnostic evaluation, prolonged and unnecessary treatment with drugs that may have additional serious adverse effects.

Should MTBDRsl by indirect testing be used to diagnose SLID resistance in patients with RR or MDR TB?

Test result

Number of results per 1000 patients

tested (95% CI) Number of

participants

(studies)

Quality of the

Evidence (GRADE) Prevalence

5%

Prevalence

10%

Prevalence

15%

True positives

(patients with SLID resistance )

38 (32 to

43)

77 (63 to

86)

115 (95 to

129)

575

(16)

⨁◯◯◯ VERY LOW

False negatives

(patients incorrectly classified

as not having SLID resistance )

12 (7 to 18) 23 (14 to

37)

35 (21 to

55)

True negatives (patients without SLID resistance )

941 (924 to

947)

892 (876 to

897)

842 (827 to

847)

1346 (16)

⨁⨁◯◯ LOW

False positives 9 (3 to 26) 8 (3 to 24) 8 (3 to 23)

Kanamycin – Large desirable effects

UNDESIRABLE EFFECTS

How substantial are the undesirable anticipated effects? ○ Large

○ Moderate ○ Small

○ Trivial

● Varies ○ Don't know

Undesirable anticipated effects per drug:

Amikacin – Small undesirable effects Capreomycin and kanamycin – moderate undesirable effects

Physicians should be guided by the MTBDRsl assay in their initial choice of an MDR-TB treatment regimen.

Conventional

phenotypic DST should be used in the follow-up evaluation of patients with a negative result especially in settings

with a high pre-test probability for resistance to SLIDs.

Page 44: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

44 | P a g e

(patients incorrectly classified as having SLID resistance )

Implications for the detection of SLID conferring mutations among RR-TB persons

TP: Test result suggests modification of a WHO recommended MDR-TB regimen. No additional harms.

Patient receive optimal regimen.

FP: Test result suggests modification of a WHO recommended MDR-TB regimen. Increased risk of serious adverse effects. Patient receive optimal regimen. FN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. Patient receive suboptimal regimen. No benefits. TN: Test result do not suggests modification of a WHO recommended MDR-TB regimen. No additional harms. Patient receive optimal regimen.

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

What is the overall certainty of the evidence of test accuracy?

● Very low ○ Low ○ Moderate ○ High ○ No included studies

In this review the risk of bias was serious

Indirectness was considered serious

Inconsistency was considered serious for sensitivity and not serious for specificity

Imprecision was considered not serious for sensitivity and specificity

Publication bias – none for all studies (both direct and indirect testing).

Quality of evidence

for test accuracy is: Sensitivity – very low quality of evidence Specificity – low

quality of evidence

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

What is the overall certainty of the evidence for any critical or important direct benefits, adverse effects or burden of the

test? ○ Very low ○ Low ○ Moderate ○ High

● No included studies

The test is labour-intensive and presents certain burden for the health worker. There is a need for appropriate infrastructure with separate rooms and biosafety requirements, which assumes a considerable investment. The burden and adverse effects are potentially insignificant for the patient.

CERTAINTY OF

THE EVIDENCE OF

MANAGEMENT'S

EFFECTS

What is the overall certainty if the evidence of effects of the

management that is guided by the test results? ○ Very low ○ Low ○ Moderate

Ideally test results should guide management decisions, provided use of test is adopted by national policy. A positive test result should be sufficient for a patient to start treatment.

Page 45: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

45 | P a g e

○ High

● No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/M

ANAGEMENT

How certain is the link between test results and management decisions? ○ Very low

○ Low ○ Moderate

○ High

● No included studies

The link between test results and management decisions may be uncertain in various settings. In some occasions clinicians use empirical treatment for TB. In others capacity of health system may be insufficient to provide the patient with necessary treatment.

Turnaround time would be faster than for conventional DST

The need for sample referral may cause delays

CERTAINTY OF EFFECTS

What is the overall certainty of the evidence of effects of the test? ○ Very low

● Low ○ Moderate ○ High

○ No included studies

This question is intended to summarize previous four questions on the certainty of the evidence. Kanamycin and Capreomycin – low certainty

Amikacin – moderate certainty

VALUES

Is there important uncertainty about or variability in how much people value the main outcomes? ○ Important uncertainty or

variability ○ Possibly important uncertainty or

variability ● Probably no important uncertainty or variability ○ No important uncertainty or

variability

○ No known undesirable outcomes

There is no important uncertainty about or variability in how much people value the main outcomes.

Page 46: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

46 | P a g e

BALANCE OF EFFECTS

Does the balance between desirable and undesirable

effects favor the intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ● Probably favors the intervention ○ Favors the intervention

○ Varies ○ Don't know

Desirable (Amikacin, Kanamycin, Capreomycin) - Large, Large, Large

Undesirable (Amikacin, Kanamycin, Capreomycin) - Small, Moderate, Moderate

Concern - FN

Accuracy for

detecting amikacin resistance is better than for capreomycin or kanamycin.

RESOURCES REQUIRED

How large are the resource requirements (costs)? ○ Large costs ○ Moderate costs

○ Negligible costs and savings ○ Moderate savings ○ Large savings

○ Varies

● Don't know

No research evidence was identified.

CERTAINTY OF EVIDENCE OF

REQUIRED RESOURCES

What is the certainty of the evidence of resource requirements (costs)? ○ Very low ○ Low

○ Moderate ○ High

● No included studies

No research evidence was identified.

Page 47: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

47 | P a g e

COST EFFECTIVENESS

Does the cost-effectiveness of the intervention favor the

intervention or the comparison? ○ Favors the comparison

○ Probably favors the comparison ○ Does not favor either the

intervention or the comparison ○ Probably favors the intervention ○ Favors the intervention

○ Varies

● No included studies

No research evidence was identified.

EQUITY

What would be the impact on health equity? ○ Reduced ○ Probably reduced ○ Probably no impact

● Probably increased ○ Increased

○ Varies ○ Don't know

System incorporating molecular methods provides more equity.

ACCEPTABILITY

Is the intervention acceptable to

key stakeholders? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies

○ Don't know

The test may be acceptable to be implemented in reference settings, where infrastructure and qualified staff

to perform MTBDRsl exist. If MTBDRsl is implemented for first-line DST the MTBDRsl assay could be performed on the same culture isolate.

FEASIBILITY

Is the intervention feasible to implement? ○ No ○ Probably no

● Probably yes ○ Yes

○ Varies ○ Don't know

Implementation of the test would require additional funding and technical support for the infrastructure upgrade, training of staff and procuring the equipment.

Page 48: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

48 | P a g e

Summary of judgments

JUDGEMENT IMPLICATIONS

PROBLEM No Probably no Probably yes Yes

Varies Don't know

TEST ACCURACY Very inaccurate Inaccurate Accurate Very accurate

Varies Don't know

DESIRABLE EFFECTS Trivial Small Moderate Large

Varies Don't know

UNDESIRABLE

EFFECTS Large Moderate Small Trivial

Varies Don't know

CERTAINTY OF THE

EVIDENCE OF TEST

ACCURACY

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF

MANAGEMENT'S

EFFECTS

Very low Low Moderate High

No included studies

CERTAINTY OF THE

EVIDENCE OF TEST

RESULT/MANAGEMENT

Very low Low Moderate High

No included studies

CERTAINTY OF

EFFECTS Very low Low Moderate High

No included studies

VALUES

Important uncertainty or variability

Possibly important

uncertainty or variability

Probably no important

uncertainty or variability

No important uncertainty or variability

No known undesirable outcomes

BALANCE OF EFFECTS Favors the Probably favors Does not favor Probably favors Favors the Varies Don't know

Page 49: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

49 | P a g e

JUDGEMENT IMPLICATIONS

comparison the comparison either the intervention or the comparison

the intervention

intervention

RESOURCES

REQUIRED Large costs Moderate costs

Negligible costs and savings

Moderate savings Large savings Varies Don't know

CERTAINTY OF

EVIDENCE OF

REQUIRED

RESOURCES

Very low Low Moderate High

No included studies

COST EFFECTIVENESS Favors the comparison

Probably favors the comparison

Does not favor either the

intervention or the comparison

Probably favors the intervention

Favors the intervention

Varies No included

studies

EQUITY Reduced Probably reduced

Probably no impact

Probably increased

Increased Varies Don't know

ACCEPTABILITY No Probably no Probably yes Yes

Varies Don't know

FEASIBILITY No Probably no Probably yes Yes

Varies Don't know

Conclusions

Should MTBDRsl by direct testing be used to diagnose SLID resistance in patients with RR or MDR TB?

TYPE OF

RECOMMENDATION Strong recommendation against the intervention

Conditional recommendation against

the intervention

Conditional recommendation for either the intervention or the

comparison

Conditional recommendation for the

intervention

Strong recommendation for the intervention

○ ○ ○ ● ○

RECOMMENDATION For patients with confirmed rifampicin-resistant TB or MDR-TB, the WHO guideline development group suggests using indirect testing of a culture of M.tuberculosis with the MTBDRsl assay as the initial test, over culture and phenotypic DST, to detect resistance to SLID (Conditional recommendation, Very low certainty in the evidence for test accuracy).

JUSTIFICATION

Page 50: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

50 | P a g e

SUBGROUP CONSIDERATIONS

Accuracy of version 2.0 assay is expected to be no worse than version 1.0 and should have improved sensitivity for detection of resistance for these drug classes.

IMPLEMENTATION

CONSIDERATIONS

Adoption of the MTBDRsl assay does not eliminate the need for conventional culture and DST capability. Despite good specificity of the MTBDRsl for the

detection of resistance to SLIDs, culture and phenotypic DST is required to completely exclude resistance to these drug classes. However, the demand for conventional culture and DST capacity may change, based on the prevalence of resistance to second-line anti-TB drugs in patients with confirmed RR-TB or MDR-TB. The following implementation considerations apply:

• Mutations in some regions (e.g., the eis promoter region) may be responsible for causing resistance to one drug in a class more than other drugs within that class. The eis C14T mutation is associated with kanamycin resistance in strains from Eastern Europe;

• Culture and phenotypic DST plays a critical role in the monitoring of patients’ response to treatment and for detecting additional resistance to second-line drugs during treatment. Patients with false negative resistance results using the MTBDRsl can be identified and captured through

treatment monitoring. Patients with false positive results might benefit from the addition of other drugs; • The availability of additional second-line drugs is critical.

MONITORING AND EVALUATION

System of quality assurance is necessary.

RESEARCH PRIORITIES

Current recommendations on the MTBDRsl assay should not prevent or restrict further research on new rapid molecular DST tests, especially for assays that can be used as close as possible to where patients are initially diagnosed with RR-TB and MDR-TB and where treatment can be initiated. Further operational research on the MTBDRsl test should focus on the following priorities:

• Develop and improved understanding of the correlation between the detection of resistance conferring mutations with phenotypic DST results

and patient outcomes; • Develop improved knowledge of the presence of specific mutations detected with the MTBDRsl assay correlated with MICs for individual drugs

within the class of SLIDs; • Review evidence to confirm or revise different critical concentrations used in phenotypic DST methods; • Determine the limit of detection of MTBDRsl for the detection of heteroresistance; • Determine training, competency, and quality assurance needs; • Gather more evidence on the impact on appropriate MDR-TB treatment initiation and mortality;

• Meet “Standards for Reporting Diagnostic accuracy studies” (STARD) for future studies; • Perform country-specific cost-effectiveness and cost-benefit analyses of MTDDRsl assay use in different programmatic settings.

Page 51: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

51 | P a g e

Annex 7. Drug concentrations used in culture-based DST for each included study

Table 1. Ofloxacin, levofloxacin, and moxifloxacin, drug concentrations used in culture-based drug susceptibility testing in relation to the WHO-recommended

critical concentrations

Study Reference standard Concentration used

(ug/ml)

Met WHO-recommended

critical concentration

Comments

Ajbani 2012 MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Barnard 2012 Middlebrook 7H11 (agar

proportion)

Ofloxacin: 2.0

Yes

Brossier 2010 LJ (agar proportion) Ofloxacin: 2.0

No

Catanzaro 2015 MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Chikamatsu 2012 Ogawa Levofloxacin: 1.0 Not applicable No WHO- recommended concentration

specified for Ogawa media

Fan 2011 MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Ferro 2013 Middlebrook 7H10 (agar

proportion)

Moxifloxacin: 2.0 Yes

FIND 2016 MGIT 960 Ofloxacin: 2.0 Yes

Levofloxacin: 1.5 Yes

Moxifloxacin: 0.5 No The WHO- recommended low level

concentration was used

Hillemann 2009 MGIT 960 and LJ Ofloxacin: 2.0 for both

media

Yes for MGIT; no for LJ

Huang 2011 MGIT 960 and Middlebrook 7H11 Ofloxacin: 2.0 Yes for both media

Ignatyeva 2012 MGIT 960 Ofloxacin: 2.0 Yes

Page 52: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

52 | P a g e

Jin 2013 LJ and BacT/ALERT 3D Ofloxacin: 5.0 (LJ); 50

(BacT/ALERT 3D)

No for LJ; Not applicable

BacT/ALERT 3D

No WHO- recommended concentration

specified for BacT/ALERT 3D media

Kambli 2015a MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Kambli 2015b MGIT 960 Levofloxacin: 1.5 Yes

Kiet 2010 LJ Ofloxacin: 2.0 No

Kontsevaya 2011 MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Kontsevaya 2013 MGIT 960 Ofloxacin: 2.0 Yes

Moxifloxacin: 0.25 No

Lacoma 2012 BACTEC 460TB Moxifloxacin: 0.5 Not applicable No WHO- recommended concentration

specified for BACTEC 460 media

Lopez-Roa 2012 MGIT 960 and Middlebrook 7H11 Ofloxacin: 2.0 Yes

Miotto 2012 MGIT 960 Ofloxacin: 2.0 Yes

NICD 2015 MGIT 960 Ofloxacin: 2.0 Yes

Said 2012 Middlebrook 7H11 Ofloxacin: 2.0 Yes

Simons 2015 MGIT 960 and Middlebrook 7H10

(agar dilution)

Moxifloxacin: 0.5 for

MGIT and 1.0 for 7H10

No For moxifloxacin using MGIT, the WHO-

recommended low level concentration was

used

Tagliani 2015 MGIT 960 and LJ (agar proportion) Ofloxacin: 2.0 for MGIT

and 4.0 for LJ

Yes

MGIT 960 Moxifloxacin: 0.5 No The WHO- recommended low level

concentration was used

MGIT 960 Levofloxacin: 1.5 Yes

Tomasicchio

2016

MGIT 960 Ofloxacin: 2.0 Yes

Tukvadze 2014 LJ (proportion method) Ofloxacin: 2.0 No

van Ingen 2010 Middlebrook 7H10 (agar Moxifloxacin: 1.0 No

Page 53: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

53 | P a g e

proportion)

Zivanovic 2012 MGIT 960 and LJ agar proportion Ofloxacin: 2.0 for both

media

Yes for MGIT; no for LJ

LJ-Löwenstein-Jensen; MGIT –Mycobacterial growth indicator tube

Reference: WHO, Updated interim critical concentrations for first-line and second-line DST (as of May 2012)

http://www.stoptb.org/wg/gli/assets/documents/Updated%20critical%20concentration%20table_1st%20and%202nd%20line%20drugs.pdf

Table 2. Amikacin, kanamycin, and capreomycin, drug concentrations used in culture-based drug susceptibility testing in relation to the WHO-recommended

critical concentrations

Study Reference standard Concentration used

(ug/ml)

Met WHO-recommended

critical concentration

Comments

Ajbani 2012 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 2.5 Yes

Capreomycin: 2.5 Yes

Barnard 2012 Middlebrook 7H11 (agar

proportion)

Amikacin: 4.0 Not applicable No WHO- recommended concentration

specified for amikacin using 7H11

Brossier 2010 LJ (agar proportion) Amikacin: 20.0 No

Kanamycin: 20.0 No

Capreomycin: 20.0 No

Catanzaro 2015 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 2.5 Yes

Capreomycin: 2.5 Yes

Chikamatsu 2012 Ogawa Amikacin: unknown Not applicable No WHO- recommended concentration

specified for Ogawa media Kanamycin: unknown Not applicable

Capreomycin: unknown Not applicable

Fan 2011 MGIT 960 Amikacin: 1.0 Yes

Ferro 2013 Middlebrook 7H10 (agar

proportion)

Amikacin: 5.0 No

Kanamycin: 5.0 Yes

FIND 2016 MGIT 960 Amikacin: 1.0 Yes

Page 54: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

54 | P a g e

Kanamycin: 2.5 Yes

Capreomycin: 2.5 Yes

Hillemann 2009 MGIT 960 and LJ (agar

proportion)

Amikacin: 1.0 for MGIT

and 40.0 for LJ

Yes for MGIT; no for LJ

Capreomycin: 2.5 for

MGIT and 40.0 for LJ

Yes Yes for both types of media

Huang 2011 Middlebrook 7H11 and MGIT 960 Amikacin: 1.0 Yes for MGIT; not applicable

for 7H11

No WHO- recommended concentration

specified for amikacin using 7H11

Kanamycin: 6.0 Yes

Capreomycin: 10.0 Not applicable

Ignatyeva 2012 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 5.0 No

Capreomycin: 2.5 Yes

Jin 2013 LJ and BacT/ALERT 3D Kanamycin: 10.0 Not applicable No WHO- recommended concentrations

specified for BacT/ALERT 3D media Capreomycin: unknown Unknown

Kiet LJ Kanamycin: 20.0 No

Kontsevaya 2013 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 5.0 No

Capreomycin: 2.5 Yes

Lacoma 2012 BACTEC 460TB Kanamycin: 5.0 Not applicable No WHO- recommended concentrations

specified for BACTEC 460 media Capreomycin: 1.25 Not applicable

Lopez-Roa 2012 Middlebrook 7H11 and MGIT 960 Amikacin: 4.0

No

Miotto 2012 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 5.0 No

Capreomycin: 2.5 Yes

NICD 2015 MGIT 960 Amikacin: 1.0 Yes

Kanamycin: 2.5 Yes

Page 55: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

55 | P a g e

Capreomycin: 2.5 Yes

Said 2012 Middlebrook 7H11 Kanamycin: 5.0 No

Capreomycin: 10.0 No

Simons 2015 MGIT 960 and Middlebrook 7H10

(agar dilution)

Amikacin: 1.0 for MGIT

and 5.0 for Middlebrook

7H10

Yes for MGIT; no for 7H10

Capreomycin: 2.5 for

MGIT and 10.0 for

Middlebrook 7H10

Yes for MGIT; no for 7H10

Tagliani 2015 MGIT 960 and LJ (agar

proportion)

Amikacin: 1.0 for MGIT

and 30.0 for LJ

Yes for both types of media

Kanamycin: 2.5 for

MGIT and 30.0 for LJ

Yes for both types of media

Capreomycin: 2.5 for

MGIT and 40.0 for LJ

Yes for both types of media

Tomasicchio

2016

MGIT 960 Amikacin: 1.0 Yes

Tukvadze 2014 LJ Kanamycin: 30.0 Yes

Capreomycin: 40.0 Yes

van Ingen 2010 Middlebrook 7H10 (agar

proportion)

Amikacin: 5.0 No

Capreomycin: 10.0 No

Zivanovic 2012 MGIT 960 and LJ agar proportion Amikacin: 1.0 for MGIT

and 40.0 for LJ

Yes for MGIT; no for LJ

Capreomycin: 2.5 for

MGIT and 40.0 for LJ

Yes for both types of media

LJ-Löwenstein-Jensen; MGIT –Mycobacterial growth indicator tube

Reference: WHO, Updated interim critical concentrations for first-line and second-line DST (as of May 2012)

http://www.stoptb.org/wg/gli/assets/documents/Updated%20critical%20concentration%20table_1st%20and%202nd%20line%20drugs.pdf

Page 56: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

56 | P a g e

Annex 8. References to studies excluded from the review of the diagnostic accuracy of MTBDRsl assay

1. Aubry A, Sougakoff W, Bodzongo P, Delcroix G, Armand S, Millot G, et al. First evaluation of drug-resistant Mycobacterium tuberculosis clinical isolates from

Congo revealed misdetection of fluoroquinolone resistance by line probe assay due to a double substitution T80A-A90G in GyrA. PLoS One. 2014;9(4):e95083.

Reason for exclusion: No cases with second-line resistance

2. Babamahmoodi F, Mahdavi MR, Jalali H, Talebi B, Roshan P, Mahdavi M. Evaluation of gene mutations involved in drug resistance in mycobacterium

tuberculosis strains derived from tuberculosis patients in Mazandaran, Iran, 2013. Int J Mol Cell Med. 2014 Summer;3(3):190-5. Reason for exclusion: not a

diagnostic accuracy study

3. Bantouna V, Kontos F, Gitti Z, Spandidos DA. Evaluation of the new GenoType MTBDRs1 (R) assay for rapid detection of resistance in Mycobacterium

tuberculosis isolates at a low-incidence community. In: International Journal of Molecular Medicine. Vol. 28. 2011:S76. Reason for exclusion: Conference abstract

4. Bergvala L, Sengstakea S, Bachyiska E, Brankova N, Tankova K, Levterova V, et al. Evaluation of a new molecular test for the identification of drug resistance in

Mycobacterium tuberculosis clinical isolates. Problems of Infectious and Parasitic Diseases 2010;38(2):27-30. Reason for exclusion: Technical study, not a

diagnostic accuracy study

5. Brossier F, Veziris N, Aubry A, Jarlier V, Sougakoff W. Detection by genotype MTBDRsl test of complex resistance mechanisms to second-line drugs and

ethambutol in multidrug-resistant strains of Mycobacterium tuberculosis. Clinical Microbiology and Infection. 2010 April;Conference: 20th ECCMID Vienna Austria.

Conference Start: 20100410 Conference End: 20100413. Conference Publication: (var.pagings). 16:S53-S4. Reason for exclusion: Conference abstract

6. Choi JH, Lee KW, Kang HR, Hwang YI, Jang S, Kim DG, et al. Clinical efficacy of direct DNA sequencing analysis on sputum specimens for early detection of drug-

resistant Mycobacterium tuberculosis in a clinical setting. Chest 2010;137(2):393-400. Reason for exclusion: not a diagnostic accuracy study

7. Fallico L, Peracchi M, Khalil S, Rassu M, Pascarella M, Manganelli R, et al. Molecular epidemiology and prevalence of mutations in Mycobacterium tuberculosis

strains from an Italian northeastern area. In: Clinical Microbiology and Infection. Vol. 18. 2012:550. Reason for exclusion: Conference abstract

Page 57: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

57 | P a g e

8. Felkel M, Exner R, Schleucher R, Lay H, Autenrieth I, Kempf VA, et al. Evaluation Of Mycobacterium tuberculosis drug susceptibility in clinical specimens from

Nigeria using Genotype MTBDRplus and MTBDRsl assays. European Journal of Microbiology and Immunology 2013;3(4):252-7. Reason for exclusion: Technical. No

diagnostic data for FLUOROQUINOLONESs, SLIDs or XDR-TB

9. Festoso I, Mantegani P, Miotto P, Cabibbe AM, Valente I, Borroni E, et al. Clinical evaluation of the GenoType MTBDRsl for the rapid diagnosis of second-line

resistance in Mycobacterium tuberculosis. In: Clinical Microbiology and Infection. Vol. 17. 2011:S592. Reason for exclusion: Conference abstract

10. Gkaravela L, Foka A, Athanassiou M, Lazarou N, Kontos F, Mollaki V, et al. The genetic diversity of Mycobacterium tuberculosis complex in Azerbaijan by 24

MIRU-VNTR loci genotyping in association with susceptibility testing by conventional and molecular methods. In: Clinical Microbiology and Infection. Vol. 18.

2012:829. Reason for exclusion: Conference abstract

11. Gomgnimbou MK, Klotoe BJ, Molina B, Dominguez J, Refrégier G, Sola C. An "all-in-one" solution for simultaneous spoligotyping and drug resistance gene

analysis of Mycobacterium tuberculosis: TB-SPRINT and TB-SPRINTplus. International Journal of Mycobacteriology. 2015. Reason for exclusion: not a diagnostic

accuracy study; no reference standard

12. Iem V, Somphavong S, Buisson Y, Steenkeste N, Breysse F, Chomarat M, et al. Resistance of Mycobacterium tuberculosis to antibiotics in Lao PDR: first

multicentric study conducted in 3 hospitals. BMC Infectious Diseases 2013;13:275. Reason for exclusion: Technical. Only one case of second-line resistance

13. Jang E, Hwang S, Ryoo S. Practical value of the Genotype MTBDRsl assay for XDR testing of Mycobacterium tuberculosis from clinical isolates. In: American

Journal of Respiratory and Critical Care Medicine. Conference: American Thoracic Society International Conference, ATS. Vol. 183. 2011. Reason for exclusion:

Conference abstract

14. Karabela S, Nikolaou S, Kouseris I, Makrigiannis N, Kanavaki S. Extensively drug-resistant tuberculosis (XDR TB) in Athens. In: International Journal of

Antimicrobial Agents. Vol. 29 (Suppl 2). 2007:S574. Reason for exclusion: Conference abstract

15. Kaswa MK, Aloni M, Nkuku L, Bakoko B, Lebeke R, Nzita A, et al. Pseudo-outbreak of pre-extensively drug-resistant (Pre-XDR) tuberculosis in Kinshasa:

collateral damage caused by false detection of fluoroquinolone resistance by GenoType MTBDRsl. J Clin Microbiol. 2014 Aug;52(8):2876-80. Reason for exclusion:

not a diagnostic accuracy study

Page 58: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

58 | P a g e

16. Kontos F, Zande M, Mavromanolakis D, Bazigos S, Manidaki A, Gitti Z. Evaluation of the new GenoType MTBDRsl assay for rapid detection of resistance in

Mycobacterium tuberculosis isolates in a low-incidence community. In: Clinical Microbiology and Infection. Vol. 17. 2011:S587. Reason for exclusion: Conference

abstract

17. Kontos F, Bobola M, Mollaki V, Karonis T, Souli M, Dimopoulos G, et al. Tuberculosis: molecular susceptibility testing reveals mixed infections with three strains.

In: Clinical Microbiology and Infection. Vol. 18. 2012:553-4. Reason for exclusion: Conference abstract

18. Lacoma A, Molina-Moya B, Prat C, Pimkina E, Diaz J, Dudnyk A, et al. Pyrosequencing for rapid detection of Mycobacterium tuberculosis second-line drugs and

ethambutol resistance. Diagnostic microbiology and infectious disease. 2015;83(3):263-9 Reason for exclusion: not a diagnostic accuracy study

19. Lemus D, Alvarez Y, Díaz R, Valdés I, Echemendía M, Martin A, et al. Molecular confirmation of resistance to first- and second-line antituberculosis drugs using

GenoType MTBDRplus and GenoType MTBDRsl assays. In: Clinical Microbiology and Infection. Vol. 17. 2011:S729. Reason for exclusion:

20. López Roa P, Ruiz-Serrano MJ, García-Escribano N, García de Viedma D, Bouza E. Rapid testing of susceptibility of multidrug-resistant Mycobacterium

tuberculosis (MDRTB) to second-line drugs using GenoType MTBDRsl. In: Abstracts of the Interscience Conference on Antimicrobial Agents and Chemotherapy. Vol.

50. 2010. Reason for exclusion: Conference abstract

21. Mindru R, Spînu V, Popa C, Botezatu E, Spătaru R.. [Conventional and molecular diagnosis on a group of patients with TB-DR]. Pneumologia (Bucharest,

Romania) 2013;63(3):168-73. Reason for exclusion: Data insufficient for 2x2 tables

22. Molina-Moya B, Lacoma A, Prat C, Diaz J, Dudnyk A, Haba L, et al. AID TB resistance line probe assay for rapid detection of resistant Mycobacterium

tuberculosis in clinical samples. Journal of Infection. 2015;70(4):400-8. Reason for exclusion: Test other than MTBDRsl

23. Niehaus AJ, Mlisana K, Gandhi NR, Mathema B, Brust JC. High Prevalence of inhA Promoter Mutations among Patients with Drug-Resistant Tuberculosis in

KwaZulu-Natal, South Africa. PLoS One. 2015;10(9):e0135003. Reason for exclusion: not a diagnostic accuracy study

24. Ouassa T, Loukou YG, Dotia A, Faye-Kette H. Molecular characterization of the resistance of Mycobacterium tuberculosis to second line drugs in Cote d'ivoire.

Tropical Journal of Pharmaceutical Research. 2014 May;13 (5):727-30. Reason for exclusion: not a diagnostic accuracy study (no reference standard)

Page 59: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

59 | P a g e

25. Singh AK, Maurya AK, Kant S, Umrao J, Kushwaha RA, Nag VL, et al. Rapid detection of drug resistance and mutational patterns of extensively drug-resistant

strains by a novel GenoType® MTBDRsl assay. Journal of Postgraduate Medicine 2013;59(3):179-85. Reason for exclusion: Technical. No information on resistance

to the pre-specified FLUOROQUINOLONESs and no cases susceptible to the SLIDs

26. Tessema B, Beer J, Emmrich F, Sack U, Rodloff AC. Analysis of gene mutations associated with isoniazid, rifampicin and ethambutol resistance among

Mycobacterium tuberculosis isolates from Ethiopia. BMC Infectious Diseases 2012;12:37. Reason for exclusion: Technical. No information on resistance to

FLUOROQUINOLONESs, SLIDs or XDR-TB.

27. Tessema B, Beer J, Emmrich F, Sack U, Rodloff AC. First- and second-line anti-tuberculosis drug resistance in Northwest Ethiopia. International Journal of

Tuberculosis and Lung Disease 2012;16(6):805–11. Reason for exclusion: Technical. No information on resistance to FLUOROQUINOLONESs, SLIDs or XDR-TB

28. Totten S, May R, Heifets LB. Comparative study of two diagnostic tools for the rapid detection of Mycobacterium tuberculosis complex from smear positive

respiratory specimens. In: American Journal of Respiratory and Critical Care Medicine. Conference: American Thoracic Society International Conference, ATS. Vol.

183. 2011:A4889 Reason for exclusion: Conference abstract

29. Walker TM, Kohl TA, Omar SV, Hedge J, Del Ojo Elias C, Bradley P, et al. Whole-genome sequencing for prediction of Mycobacterium tuberculosis drug

susceptibility and resistance: a retrospective cohort study. Lancet Infect Dis. 2015 Jun 23. Reason for exclusion: not a diagnostic accuracy study

30. Wedajo W, Schon T, Bedru A, Kiros T, Hailu E, Mebrahtu T, et al. A 24-well plate assay for simultaneous testing of first and second line drugs against

Mycobacterium tuberculosis in a high endemic setting. BMC Res Notes. 2014;7:512. Reason for exclusion: not a diagnostic accuracy study, insufficient data for 2x2

table

31. Zhang L, Duo L, Lu X, Xie Y, Song X, Kang M, et al. Molecular epidemiology of multidrug-resistant (MDR) Mycobacterium tuberculosis revealed by GenoType

MTBDR assays in southern China. In: Clinical Microbiology and Infection. Vol. 17. 2011:S599-600. Reason for exclusion: Conference abstract

Page 60: Online annexes MTBDRsl - WHO...4 Footnotes. 1. Eight studies used a cross-sectional study design and one study used a case-control study design. 2. The QUADAS-2 tool was used to assess

Recommended