341
views
0
recommends
+1 Recommend
0 collections
    8
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Errors generated by a point-of-care CD4+ T-lymphocyte analyser: a retrospective observational study in nine countries Translated title: Erreurs générées par l'analyseur de lymphocytes T CD4+ sur le lieu d'intervention: une étude rétrospective par observation dans neuf pays Translated title: Errores generados por un analizador de linfocitos en el punto de atención CD4+ T: un estudio observacional retrospectivo en nueve países Translated title: الأخطاء الصادرة بفعل جهاز تحليل خلايا اللمفاويات التائية CD4+ لنقطة الرعاية السريرية: دراسة رصدية بأثر رجعي في تسعة بلدان Translated title: 医疗点的 CD4+ T-淋巴细胞分析器产生的错误: 一项在九个国家开展的回顾性观察研究 Translated title: Ошибки анализатора при подсчете CD4+ T-лимфоцитов в пункте первичного обращения: ретроспективное обсервационное исследование в девяти странах

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Objective

          To estimate the proportion of invalid results generated by a CD4+ T-lymphocyte analyser used by Médecins Sans Frontières (MSF) in field projects and identify factors associated with invalid results.

          Methods

          We collated 25 616 CD4+ T-lymphocyte test results from 39 sites in nine countries for the years 2011 to 2013. Information about the setting, user, training, sampling technique and device repair history were obtained by questionnaire. The analyser performs a series of checks to ensure that all steps of the analysis are completed successfully; if not, an invalid result is reported. We calculated the proportion of invalid results by device and by operator. Regression analyses were used to investigate factors associated with invalid results.

          Findings

          There were 3354 invalid test results (13.1%) across 39 sites, for 58 Alere Pima TM devices and 180 operators. The median proportion of errors per device and operator was 12.7% (interquartile range, IQR: 10.3–19.9) and 12.1% (IQR: 7.1–19.2), respectively. The proportion of invalid results varied widely by country, setting, user and device. Errors were not associated with settings, user experience or the number of users per device. Tests performed on capillary blood samples were significantly less likely to generate errors compared to venous whole blood.

          Conclusion

          The Alere Pima CD4+ analyser generated a high proportion of invalid test results, across different countries, settings and users. Most error codes could be attributed to the operator, but the exact causes proved difficult to identify. Invalid results need to be factored into the implementation and operational costs of routine CD4+ T-lymphocyte testing.

          Résumé

          Objectif

          Estimer la proportion de résultats non valides générés par l'analyseur de lymphocytes T CD4+ utilisé par Médecins Sans Frontières (MSF) dans les projets de terrain et déterminer les facteurs associés aux résultats non valides.

          Méthodes

          Nous avons rassemblé 25 616 résultats de tests des lymphocytes T CD4+ réalisés sur 39 sites dans neuf pays entre 2011 et 2013. Un questionnaire a permis d'obtenir des informations sur le lieu, l'utilisateur, la formation, la méthode d'échantillonnage et les réparations effectuées sur l'appareil. L'analyseur réalise une série de contrôles afin de garantir que toutes les étapes de l'analyse se déroulent correctement; si ce n'est pas le cas, il indique un résultat non valide. Nous avons calculé la proportion de résultats non valides par appareil et par opérateur. Des analyses de régression ont permis de rechercher les facteurs associés aux résultats non valides.

          Résultats

          Nous avons relevé 3354 résultats de tests non valides (13,1%) sur les 39 sites, avec 58 appareils Alere PimaTM et 180 opérateurs. La proportion moyenne d'erreurs par appareil et par opérateur était respectivement de 12,7% (intervalle interquartile, IQR: 10,3–19,9) et de 12,1% (IQR: 7,1-19,2). La proportion de résultats non valides variait considérablement en fonction du pays, du lieu, de l'utilisateur et de l'appareil. Les erreurs n'étaient pas associées aux lieux, à l'expérience de l'utilisateur ou au nombre d'utilisateurs par appareil. Les tests effectués sur des prélèvements de sang capillaire étaient nettement moins susceptibles de générer des erreurs que ceux réalisés sur du sang veineux total.

          Conclusion

          L'analyseur de CD4+ Alere Pima a généré une proportion élevée de résultats de tests non valides, dans différents pays, différents lieux et avec différents utilisateurs. La plupart des codes d'erreur ont pu être imputés à l'opérateur, mais les causes exactes se sont avérées difficiles à déterminer. Les résultats non valides doivent être pris en compte dans les coûts de mise en œuvre et d'exploitation des tests de routine des lymphocytes T CD4+.

          Resumen

          Objetivo

          Estimar la proporción de resultados no válidos generados por un analizador de linfocitos CD4+ T utilizado por Médicos sin Fronteras (MSF) en proyectos de campo e identificar los factores asociados a los resultados no válidos.

          Métodos

          Se recopilaron 25 616 resultados de pruebas de linfocitos CD4+ T de 39 localizaciones en nueve países entre los años 2011 y 2013. La información sobre el entorno, los usuarios, la formación, la técnica de muestreo y el historial de reparación del dispositivo se obtuvo a través de un cuestionario. El analizador lleva a cabo una serie de chequeos para asegurar que se completan con éxito todos los pasos del análisis; si no es así, se informa de un resultado no válido. Se calculó la proporción de resultados no válidos por dispositivo y operador. Se utilizaron análisis de regresión para investigar los factores asociados con los resultados no válidos.

          Resultados

          Hubo 3354 resultados no válidos de pruebas (13,1%) en 39 localizaciones, para 58 dispositivos Alere Pima TM y 180 operadores. La proporción media de errores por dispositivo y operador fue del 12,7% (rango intercuartílico, RIC: 10,3–19,9) y del 12,1% (RIC: 7,1-19,2), respectivamente. La proporción de resultados no válidos varió ampliamente entre países, entornos, usuarios y dispositivos. Los errores no estaban asociados con los entornos, la experiencia del usuario o el número de usuarios por dispositivo. Las pruebas realizadas con muestras de sangre capilar tenían menos posibilidades de generar error que las realizadas con sangre entera venosa.

          Conclusión

          El analizador Alere Pima CD4+ generó una alta proporción de resultados no válidos de pruebas en diferentes países, entornos y usuarios. La mayoría de los códigos de error podrían atribuirse al operador, pero resultó difícil identificar las causas exactas. Los resultados no válidos de las pruebas rutinarias de linfocitos CD4+ T deberían tenerse en cuenta en la aplicación y los costes operacionales.

          ملخص

          الغرض

          تقدير نسبة النتائج غير الصالحة الصادرة عن جهاز تحليل خلايا اللمفاويات التائية ‎CD4+ الذي تستخدمه منظمة أطباء بلا حدود (MSF) في المشروعات الميدانية وتحديد العوامل المرتبطة بالنتائج غير الصالحة.

          الطريقة

          لقد جمعنا 25,616 نتيجة اختبار لخلايا اللمفاويات التائية CD4+ من 39 موقعًا في تسعة بلدان في الفترة ما بين عاميّ 2011 إلى 2013. وتم الحصول على معلومات عن البيئة، والمستخدمين، والتدريب، وتقنية سحب العينات، وتاريخ إصلاح الجهاز عن طريق الاستبيان. يقوم جهاز التحليل بإجراء سلسلة من عمليات التحقق للتأكد من اكتمال جميع خطوات التحليل بنجاح؛ وفي حال عدم نجاحها، فسيتم الإبلاغ عن صدور نتيجة غير صالحة. وقد احتسبنا نسبة النتائج غير الصالحة الصادرة عن الجهاز وعن المُشغِّل. تم استخدام تحاليل التحوف لاستقصاء العوامل المرتبطة بالنتائج غير الصالحة.

          النتائج

          كانت هناك 4335 نتيجة اختبار غير صالحة (بنسبة تبلغ 13.1%) عبر 39 موقعًا لعدد 58 جهازًا من طراز Alere Pima TM ‎ و180 من المُشغِّلين. بلغت نسبة متوسط الأخطاء لكل جهاز ومُشغِّل 12.7% (المدى الربيعي: 10.3–19.9) و12.1% (المدى الربيعي: 7.1–19.2)، على التوالي. واختلفت نسبة النتائج غير الصالحة بشكل واسع حسب البلد والبيئة والمستخدم والجهاز. لم تكن الأخطاء مرتبطة ببيئة الاستخدام، ولا خبرة المستخدم، ولا عدد المستخدمين في كل جهاز. وكان احتمال صدور الأخطاء في الاختبارات التي أجريت على عينات الدم الشعري واردًا بدرجة أقل كثيرًا بالمقارنة مع عينات الدم الكامل الوريدي.

          الاستنتاج

          أصدر جهاز التحليل Alere Pima CD4+‎ نسبة عالية من نتائج الاختبار غير الصالحة، عبر بلدان وبيئات استخدام ومستخدمين مختلفين. يمكن عزو معظم رموز الخطأ إلى المُشغِّل، ولكن ثبت أنه من الصعب تحديد الأسباب الحقيقية. هناك حاجة لمراعاة النتائج غير الصالحة في تكاليف التنفيذ والتشغيل لاختبار خلايا اللمفاويات التائية CD4+‎ الروتيني.

          摘要

          目的

          旨在评估由无国界医生组织  (MSF)  用于实地项目的 CD4+ T-淋巴细分析器产生无效结果的比例,并确认与无效结果相关的因素。

          方法

          我们从 9 个国家的 39 个医疗点中获取了 25 616 项在 2011 年至 2013 年期间关于 CD4+ T-淋巴细胞的测试结果。通过调查问卷获得了关于环境、用户、培训、采样技术和设备维修记录的信息。 分析器会进行一系列检查,以确保分析的所有步骤都能成功完成;如果不能,则报告无效结果。 我们通过设备和操作员计算了无效结果的比例。 回归分析用于调查与无效结果有关的因素。

          结果

          在 34 个医疗点的 58 个 Alere Pima TM 设备和 180 名操作员中,出现了 3354 项无效测试结果  (13.1%)。 每个设备和操作员的错误比例中值分别为 12.7%(四分位差,IQR: 10.3–19.9)  和 12.1% (IQR: 7.1–19.2)。 无效结果的比例因国家、环境、用户和设备而异。 每个设备的错误与环境、用户经验或用户数量无关。 与静脉全血相比,关于毛细管血样的测试出现错误的可行性更低。

          结论

          Alere Pima CD4+ 分析器在不同国家、环境和用户中出现无效测试结果的比例很高。 大多数错误代码归因于操作员,但是很难确认出确切的原因。 无效结果需在 CD4+ T-淋巴细胞常规测试的实施和操作成本中作为因素纳入考虑。

          Резюме

          Цель

          Оценить долю недействительных результатов, выдаваемых анализатором количества CD4+ T-лимфоцитов в полевых условиях в рамках проектов организации «Врачи без границ» (Médecins Sans Frontières, MSF), и выявить факторы, вызывающие недействительные результаты.

          Методы

          Мы сравнили 25 616 результатов определения CD4+ T-лимфоцитов в 39 медицинских учреждениях из девяти стран за два года (с 2011 по 2013 год). Информация относительно условий проведения анализа, а также сведения о пользователе, его обучении, методике отбора проб и истории ремонта измерительного прибора была получена в ходе анкетирования. Анализатор выполняет ряд проверок для того, чтобы удостовериться в успешном выполнении всех этапов анализа. В противном случае выдается сообщение о недействительном результате. Мы рассчитали долю недействительных результатов для каждого устройства и каждого оператора. Для изучения факторов, вызывающих недействительные результаты, был проведен регрессионный анализ.

          Результаты

          В 39 учреждениях, где использовалось 58 устройств серии Alere Pima TM и работало 180 операторов, было выявлено 3354 недействительных результата исследований (13,1%). Медианная доля ошибок в пересчете на устройство и оператора составила 12,7% (межквартильный размах, МКР: 10,3–19,9) и 12,1% (МКР: 7,1–19,2) соответственно. Доля недействительных результатов в значительной мере варьировалась в зависимости от страны, условий проведения анализа, пользователя и устройства. Ошибки не были связаны с условиями проведения анализа, опытом пользователя или количеством пользователей для одного и того же устройства. Если для анализа использовалась кровь из пальца, появление недействительных анализов было значительно менее вероятно, чем при использовании проб венозной крови.

          Вывод

          Анализатор Alere Pima CD4+ выдает значительный процент недействительных результатов в зависимости от страны, условий проведения анализа и участия различных операторов. Возникновение большинства ошибок связано с работой операторов, но определить точную причину оказалось затруднительно. Недействительные результаты следует учитывать при определении расходов на внедрение и осуществление регулярных подсчетов количества CD4+ T-лимфоцитов.

          Related collections

          Most cited references51

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          Retention in HIV Care between Testing and Treatment in Sub-Saharan Africa: A Systematic Review

          Introduction The remarkable expansion of access to antiretroviral therapy (ART) for HIV/AIDS in resource-constrained countries has given nearly four million HIV-positive adults in sub-Saharan Africa the opportunity to achieve what for many may be nearly normal life expectancies [1]. Others, however, do not make it past their first year on treatment. The rate of early mortality and loss to follow-up, which itself portends mortality for many, averages 23% across the region [2]. For patients initiating ART late, with very low CD4 counts, the odds of success are even lower: in a pooled analysis of data from multiple resource-limited countries, patients with starting CD4 counts below 25 cells/mm3 faced a more than 3-fold increased risk of death compared to those with starting CD4 counts above 50 cells/mm3 [3]. Those who survive suffer more morbidity and utilize more medical care resources than would otherwise have been necessary [4]. Earlier initiation of ART requires earlier diagnosis and regular monitoring until treatment eligibility. Despite large-scale HIV testing campaigns to hasten diagnosis [5] and the raising of CD4 count thresholds to allow earlier ART eligibility [1], late presentation for AIDS treatment remains the norm. Median baseline CD4 counts have increased only modestly in the years since treatment became available [6],[7], and most programs still report medians well below even the very low threshold of 200 cells/mm3 previously allowed by most treatment guidelines [2]. The persistence of low starting CD4 counts points to a problem that has just begun to be recognized in the research literature: poor pre-ART retention in care, or the failure to link patients from HIV testing to HIV care and retain them in care until they are eligible for ART. Without effective retention in pre-ART care, beginning with HIV testing and continuing until the first antiretrovirals are dispensed, even patients who have long been aware of their HIV status will access care only when seriously ill, which is often well after treatment eligibility. A prerequisite to developing interventions to retain patients in care between testing and treatment is an understanding of where and when they are being lost. Research on retention in pre-ART care is challenging, as it requires long periods of follow-up and consistent information systems that allow individuals to be tracked as they move in and out of care at multiple facilities. As a result, only a handful of quantitative studies reporting on rates of pre-ART linkage and loss have been published. In this paper, we review those studies and summarize what is known about this issue in sub-Saharan Africa. Our objective is to determine whether existing data allow us to estimate what proportion of adult patients who test positive for HIV are staged, enroll, and remain in pre-ART care until ART-eligible, and initiate ART as soon as eligible. Methods Ethics Statement An ethics statement was not required for this work. Search Strategy We conducted a systematic literature review of patient retention between HIV testing and ART initiation in sub-Saharan Africa. Following a detailed search protocol and standard systematic review procedures (Texts S1 and S2), we searched the published literature and major conference abstract archives for reports containing primary, patient- or facility-level data from routine health-care delivery settings on the proportion of patients retained in care between HIV testing and ART initiation and/or rates of linkage between any two intermediate points between testing and ART. We excluded patients who were in care solely for the purpose of preventing mother-to-child transmission of HIV, patients who were in pediatric care, modeled estimates without primary data, qualitative studies, and clinical trials that did not take place under routine care conditions. We included reports of trials of procedural changes within facilities. Where multiple reports described the same data, the one reporting the most complete follow-up or with the clearest definitions of outcomes was used. We did not place a language restriction on the papers included in our search but did limit the search to English-language indices. We searched PubMed and the ISI Web of Knowledge through January 5, 2011, with the combined terms “Africa” and “HIV” plus “retention,” “linkage,” or “pre-ART.” We searched the African Indicus Medicus through April 1, 2011, using the same terms. We also searched abstracts from the conferences of the International AIDS Society from 2008 to 2010 and from the Conference on Retroviruses and Opportunistic Infections from 1997 to 2011, and scanned the titles of abstracts presented at the HIV Implementers Meetings in 2008 and 2009 and the 5th International Conference on HIV Treatment Adherence (2010). Finally, we reviewed the reference lists of all papers found through the PubMed and ISI Web of Knowledge searches. S. R. assessed the eligibility of all abstracts and journal articles that met our initial criteria, and M. P. F. confirmed eligibility. Using a standard data extraction form, both authors extracted and reviewed the relevant data, including study site, sample size and inclusion criteria, dates of data collection, study design and outcomes, and quantitative results. Data Analysis We anticipated that wide variation in definitions, outcomes, and specific components of pre-ART care evaluated in the studies would prevent aggregate statistical analysis of findings beyond a basic descriptive level. We therefore began by describing each study, identifying the start and end points of the data presented, and specifying the proportions of patients retained or linked. We defined “loss to care” as failing to reach the next step in the care sequence for any reason (death or discontinuation), but we also accepted each study's own criteria for determining which patients died or discontinued care. Transfers were rarely distinguished from losses in the published studies. Where possible, we used the reported data to calculate a 95% confidence interval for the proportion of patients retained or linked. Next, we grouped the findings into stages within the testing-to-ART-initiation sequence, as described below, and illustrated the results using forest plots. Finally, for each stage we estimated the median proportion of patients completing the stage and reported the median and range. Classification of Results Preliminary review of the literature suggested that the sequence of events that starts with testing positive for HIV and ends with initiating ART can usefully be grouped into three stages, as illustrated in Figure 1. For analysis, we categorized each study by stage, allowing some studies to be included in more than one stage as appropriate. 10.1371/journal.pmed.1001056.g001 Figure 1 Stages of pre-ART care. Stage 1, in which the patient is staged for referral to either pre-ART care or ART, starts immediately after a patient tests positive for HIV infection. Depending on the technology available and the testing setting, Stage 1 typically requires the patient to make one or two additional visits to a clinic. A blood sample for a CD4 count can be given during the same visit as the HIV test if the test is conducted at a clinic; if the test is done at a stand-alone testing site, the patient is typically referred elsewhere to provide a blood sample. Once the sample has been taken, patients are asked to return 2 d to 2 wk later to receive their results, with the time interval dependent on laboratory processing capacity and location. Completion of Stage 1 requires that patients receive their CD4 count results (or clinical staging outcome) and be referred onward for pre-ART care or ART. Stage 2 lasts from enrollment in pre-ART care until eligibility for ART. Stage 2 pertains only to patients who complete Stage 1 prior to ART eligibility, as those already eligible for ART at staging will be referred directly to Stage 3. The steps included in Stage 2 are generally poorly defined in the literature and vary widely from program to program. In some programs “enrollment in care” happens automatically when a patient presents at a site, regardless of patient intention, while in others it requires active patient participation. Patients may be considered enrolled in care prior to staging or only after having been found not-yet-eligible for ART. At a minimum, retention in pre-ART care requires regular clinic visits for monitoring of patient condition. The frequency and content of these visits varies widely: patients with very high CD4 counts may be asked to return as infrequently as once a year, while those approaching treatment eligibility may be monitored on a monthly or quarterly basis. Similarly, some programs routinely dispense cotrimoxazole, isoniazid, vitamins, and/or food supplements to pre-ART patients, while others simply assess condition. For practical purposes, completion of Stage 2 requires that ART eligibility be determined prior to the patient's CD4 count falling substantially below the eligibility threshold or the patient becoming severely ill. Finally, Stage 3 encompasses the steps between determination of ART eligibility and ART initiation. Programs in sub-Saharan Africa typically require two or more “treatment readiness” visits during this stage, and the full course of treatment education and adherence training can last for up to 8 wk. Completion of Stage 3 requires that the patient be dispensed a first dose of antiretrovirals. Results We identified 668 full-length journal articles and 1,145 abstracts potentially relevant to our review. As shown in the search flowchart in Figure 2, after excluding duplicates and studies that did not meet the geographic, population, content, or design criteria of our review, 20 full-length articles and eight abstracts were eligible for the review. Most (23/28) were published or presented in 2009 or later. Seven countries are represented, but half the studies (14/28) were conducted in just one, South Africa. Most (18/28) were designed as retrospective cohorts using routinely collected patient-level data; the remaining were program evaluations, trials of procedural changes, and a prospective cohort. The studies are described in Table 1, which also contains the study codes we will use to refer to individual studies throughout this paper. Of the 28 studies included, 20 reported information relevant to only one stage in the testing-to-treatment sequence, six addressed two stages, and two addressed to all three stages. We thus had a total of 38 stage-specific observations. 10.1371/journal.pmed.1001056.g002 Figure 2 Flow chart of literature search on pre-ART retention in care. Adherence conference, 5th International Conference on HIV Treatment Adherence; CROI, Conference on Retroviruses and Opportunistic Infections; IAS, International AIDS Society; Implementers conference, HIV Implementers Meetings. 10.1371/journal.pmed.1001056.t001 Table 1 Studies included in this review of retention in pre-ART HIV care in sub-Saharan Africa. Study Code Year Location Sample (N) Dates Design Ethiopia 1 [16] 2010 Ethiopia: national sample of public sector sites HIV+ patients referred for care (1,314) 2005–2008 Evaluation of aggregate site-level reports Ethiopia 2 [17] 2009 Ethiopia: 33 public sector facilities HIV+ patients referred for care (1,102) Jan–Dec 2008 Evaluation of improved referral procedures through collection of referral slips brought to referral clinic by patients after testing Ethiopia 3 [18] 2010 Ethiopia: Arba Minch Hospital HIV+ patients presenting at HIV clinic (2,191) Jan 2003–31 Dec 2008 Retrospective cohort Kenya 1 [19] 2007 Kenya: Migori District Hospital, Nyanza Province ART-eligible patients from PMTCT program (159) Apr 2004–Sep 2005 Retrospective cohort; limited to PMTCT participants and partners Kenya 2 [20] 2011 Kenya: multiple facilities, Nyanza Province HIV+ patients accepting home-based testing and follow-up interview (737) Feb 2008–Jul 2009 Household survey of participants in home-based HIV testing study; self-reported data Kenya 3 [14] 2011 Kenya: Coptic Hope Center for Infectious Diseases, Nairobi ART-ineligible patients enrolled in pre-ART care program with a baseline CD4 count (610) 2005–2007 Retrospective cohort Malawi 1 [21] 2010 Malawi: Martin Preuss Centre, Bwaila District Hospital, Lilongwe ART-eligible pregnant women referred from PMTCT site to ART site (742) Dec 2006–Jan 2010 Retrospective cohort Malawi 2 [22] 2010 Malawi: Thyolo District Hospital All newly registered care patients in WHO stages 1/2 not on ART and enrolled >1 mo before data censoring (1,428) 1 Jun 2008–10 Feb 2009 Retrospective cohort Malawi 3 [23] 2006 Malawi: Thyolo District Hospital HIV+ TB patients who completed first 8 wk of TB treatment and became eligible for ART (742) Feb 2003–Jul 2004 Retrospective cohort; limited to TB patients Mozambique 1 [24] 2009 Mozambique: two urban HIV care networks HIV+ patients (6,999) 1 Jul 2004–30 Jun 2005 Facility-level analysis of numbers completing each step SA 1 [25] 2009 South Africa: two clinics, Cape Town township HIV+ patients (375); ART-eligible patients (75) 2006a Retrospective cohort; excluded pregnant women SA 2 [26] b 2009 South Africa: McCord Hospital, Durban ART-eligible adults who stated intention to start ART at site and were assessed as “psychosocially ready” for treatment (501) Jul–Dec 2006c Retrospective cohort SA 3 [27] b 2010 South Africa: McCord and St. Mary's Hospitals, Durban HIV+ patients (1,474) Nov 2006–Jun 2009 Prospective cohort SA 4 [28] 2010 South Africa: 36 facilities, Free State Province Patients enrolled in care with CD4 count reported (33,122) May 2004–Dec 2008 Retrospective cohort SA 5 [29] 2008 South Africa: Hannan Crusaid Treatment Centre, Gugulethu ART-eligible patients (2,131) 1 Sep 2002–30 Sep 2007 Retrospective cohort; limited to female patients SA 6 [30] 2010 South Africa: Cape Town township public clinic HIV+ patients (988) Jan 2004–Mar 2009 Retrospective cohort SA 7 [31] 2010 South Africa: Themba Lethu Clinic, Helen Joseph Hospital, Johannesburg HIV+ patients (416) Jan 2008–Feb 2009 Retrospective cohort SA 8 [32] 2010 South Africa: Themba Lethu Clinic, Helen Joseph Hospital, Johannesburg Patients enrolled in pre-ART care program (356) Jan 2007–Feb 2008 Retrospective cohort SA 9 [33] 2006 South Africa: Gugulethu Community Health Centre, Western Cape Province ART-eligible patients enrolled at ART clinic (1,235) Sep 2002–Aug 2005 Retrospective cohort SA 10 [34] 2010 South Africa: Hlabisa Care and Treatment Program, KwaZulu Natal Province HIV+ patients not eligible for ART (4,223) 1 Jan 2007–30 Jan 2009 Retrospective cohort SA 11 [35] b 2010 South Africa: McCord and St. Mary's hospitals, Durban HIV+ patients (454) Nov 2006–May 2007 Prospective cohort SA 12 [36] 2010 South Africa: Gauteng Province HIV+ patients who enrolled in trial (199) Not reported Preliminary data for cohort enrolled in trial; self-reported data; limited to female IDUs and CSWs SA 13 [37] 2010 South Africa: Esselen St. Clinic, Hillbrow, Johannesburg HIV+ patients (224) Not reported Trial of immediate or 1-wk CD4 results; source reported only on 1-wk outcomes SA 14 [38] 2011 South Africa: mobile testing units, Cape Metropolitan Region, Western Cape Province HIV+ patients (192) Aug 2008–Dec 2009 Phone follow-up of patients who tested positive at mobile testing units, with confirmation by record review Tanzania 1 [39] 2009 Tanzania: VCT site and clinic in Kisesa Ward HIV+ patients (349) Mar 2005–Feb 2008 Evaluation of referral forms Uganda 1 [40] 2009 Uganda: AIDS Support Clinic, Jinja ART-eligible patients (2,483) Sep 2004–Dec 2006c Retrospective cohort Uganda 2 [41] 2010 Uganda: Mulago Hospital, Kampala HIV+ in-patients (208) Mar 2004–Mar 2005c Trial of offering HIV test during inpatient stay or referral to outpatient HIV test after discharge; limited to previously hospitalized patients Uganda 3 [42] 2011 Uganda: Immune Suppression Syndrome (ISS) Clinic, Mbarara ART-eligible patients (2,639) Oct 2007–Jan 2011 Retrospective cohort a Used data for 2006 only because data provided for earlier years were incomplete. b Samples in SA 2, SA 3, and SA 11 may overlap. c Follow-up may have continued beyond this date; source ambiguous. CSW, commercial sex worker; IDU, intravenous drug user; PMTCT, prevention of mother-to-child transmission; TB, tuberculosis; VCT, voluntary counseling and testing. Stage 1: Testing to Staging Ten studies reported rates of staging after a positive HIV test (Table 2 and Figure 3). Time intervals for evaluating results varied widely, from 1 wk to 6 mo. In general, between one-third and two-thirds of patients testing positive for HIV provided samples for CD4 counts and/or returned for results within 2–3 mo of the HIV test. For all the studies in Table 2, the median proportion of patients completing one or both of the steps in Stage 1 was 59% (range 35%–88%). 10.1371/journal.pmed.1001056.g003 Figure 3 Forest plot of the ten studies reporting on the proportion of patients completing Stage 1 or steps within Stage 1. Bars indicate 95% confidence intervals. Studies shown in the plot report to differing end points; refer to Table 2 for details. 10.1371/journal.pmed.1001056.t002 Table 2 Reported rates of retention or linkage in Stage 1 (HIV testing to staging). Study Code Outcome Assessed N Number Achieving Outcome Percent (95% CI) Achieving Outcome Comments Provided sample for CD4 count SA 1 ≤6 mo of HIV test 375 232 62% (57%–67%) Source does not specify whether patients returned for results SA 6 ≤6 mo of HIV test 988 621 63% (60%–66%) Source states that authors do not know whether patients returned for results; mean for those providing sample in >6 mo = 490 d >6 mo of HIV test 988 112 11% (9%–13%) Never 988 255 26% (23%–29%) Returned for CD4 count results after providing sample Malawi 2 ≤1 mo of registering for care 1,428 784 55% (52%–57%) SA 7 ≤12 wk of HIV test 352 122 35% (30%–40%) SA 13 ≤1 wk of providing sample 224 106 47% (41%–54%) SA 14 Ever 192 149 78% (72%–84%) No maximum time limit indicated Uganda 1 Ever 2,483 2,182 88% (87%–89%) All patients enrolled in study were ART-eligible at time of providing CD4 count sample; no maximum time limit indicated Of above total, returned ≤21 d 2,483 1,637 66% (64%–68%) Provided sample and returned for CD4 count results Mozambique 1 ≤60 d of HIV test 6,999 3,046 44% (42%–45%) Of above total, enrolled in care ≤30 d of HIV test 7,005 3,950 56% (55%–58%) Of above total, returned for CD4 results ≤30 d of enrollment 3,950 3,046 77% (76%–78%) SA 3 ≤90 d of HIV test 1,474 1,012 69% (66%–71%) Source is ambiguous but appears to refer to receipt of CD4 results, rather than solely provision of sample SA 11 Ever 454 212 47% (42%–51%) No maximum time limit is indicated for returning for results Of above total, provided sample for CD4 testing ≤8 wk of HIV test 454 248 55% (50%–59%) Of above total, ever returned for results 248 212 85% (81%–89%) No maximum time limit is indicated for returning for results Stage 2: Staging to ART Eligibility Fourteen studies reporting on retention in pre-ART care between staging and ART eligibility (Stage 2) are shown in Table 3 and Figure 4. The upper rows of Table 3, which report on enrollment in pre-ART care after a positive HIV test, clearly overlap with some of the studies classified as Stage 1 and presented in Table 2, but we placed them in Stage 2 because they focus on pre-ART care rather than staging. Similarly, many of the studies in the lower rows of Table 3, which report on retention in pre-ART care after enrollment, use ART initiation as an end point, overlapping with Stage 3. 10.1371/journal.pmed.1001056.g004 Figure 4 Forest plot of the 14 studies reporting on the proportion of patients completing Stage 2 or steps within Stage 2. Bars indicate 95% confidence intervals. Studies shown in the plot report to differing end points; refer to Table 3 for details. 10.1371/journal.pmed.1001056.t003 Table 3 Reported rates of retention or linkage in Stage 2 (staging to ART eligibility). Study Code Outcome Assessed N Number Achieving Outcome Percent (95% CI) Achieving Outcome Comments HIV test to enrollment in care Ethiopia 1 “Immediate” linkage to HIV care after HIV test 1,314 623 47% (45%–50%) “Linked to care” and “immediately” not defined in report Ethiopia 2 Visited referral site (HIV clinic) after HIV test 1,102 474 43% (40%–46%) Of 474 visiting referral site, 84% visited ≤8 wk of HIV test Kenya 2 Self-reported attendance at HIV care services 2–4 mo after HIV test 737 312 42% (39%–46%) SA 8 Attended first pre-ART medical appointment ≤1 y of staging 356 112 31% (27%–36%) SA 12 Visited referral site (HIV clinic) after HIV test 199 92 46% (39%–53%) Self-reported data; time allowed to reach end point not stated SA 14 Self-reported access of HIV care 135 49 36% (28%–44%) Of those not linked, 1% died and 41% not reached by phone. Self-reported data confirmed by record review. Time limit for accessing care not clear Tanzania 1 Registered at HIV clinic ≤6 mo of referral from testing 349 237 68% (63%–73%) Uganda 2 Self-reported attendance at HIV clinic ≤6 mo of HIV test 203 92 45% (39%–52%) Self-reported data; denominator includes 55 patients who died ≤3 mo of HIV test Retention in pre-ART care after enrollment Ethiopia 3 Percent initiating care or still in care at date of data censoring (follow-up duration unknown) 2,191 1,540 70% (68%–72%) Of 651 not retained, 102 died and 549 lost to follow-up; proportion retained includes 34 who transferred out of program Kenya 3 250 cells/mm3 at enrollment who enrolled in HIV care, provided sample for CD4 count, and initiated ART by date of data censoring 1,633 808 49% 95% of losses to follow-up occurred in Stage 1; does not report stage completion for patients still in pre-ART care at data censoring SA 6 Stages 1–3. HIV testing to staging, retention in pre-ART care, and ART eligibility to ART initiation Proportion who initiated ART or had a repeat CD4 count by date of data censoring 988 330 33% Does not report stage completion for patients not eligible for ART upon receipt of first CD4 count results SA 4 Stages 2 and 3. Staging to ART initiation or data censoring Proportion of those enrolled in program and with CD4 count reported who initiated ART or remained in care at date of data censoring 33,122 18,851 57% Does not report stage completion for patients not eligible for ART upon receipt of first CD4 count results SA 14 Stages 1 and 2. HIV testing to staging, and staging to enrollment in care Proportion who returned for CD4 count results 192 149 77% Does not report time limit for completing steps Proportion of those who returned for CD4 count results who reported accessing HIV care 135 49 36% Mozambique 1 Stages 1 and 3. HIV testing to staging, and ART eligibility to ART initiation Proportion who returned for CD4 count results ≤60 d of HIV test 6,999 3,046 44% Does not report outcomes for patients not eligible for ART upon receipt of CD4 count results Proportion of those ART-eligible at first CD4 count who initiated ART ≤90 d of CD4 count 1,506 417 31% SA 1 Stages 1 and 3. HIV testing to staging, and ART eligibility to ART initiation Proportion who had C4 count ≤6 mo 375 233 62% Does not report outcomes for patients not eligible for ART upon receipt of CD4 count results Proportion of those ART-eligible at first CD4 count who initiated ART ≤6 mo of HIV test 75 51 68% SA 3 Stages 1 and 3. HIV testing to staging, and ART eligibility to ART initiation Proportion who returned for CD4 count results ≤90 d of HIV test 1,474 1,012 69% Does not report outcomes for patients not eligible for ART upon receipt of CD4 count results Proportion of those ART-eligible at first CD4 count who initiated ART ≤12 mo of CD4 count 538 210 39% Uganda 1 Stages 1 and 3. HIV testing to staging, and ART eligibility to ART initiation Of those who provided samples for CD4 count and were ART-eligible, proportion initiating ART vwithin an unspecified time period (<1 y) 2,483 1,846 74% Excluded patients not yet ART-eligible at time of first CD4 count Discussion During the early years of HIV/AIDS treatment scale up in sub-Saharan Africa, attention was focused on initiating eligible patients on ART and, more recently, on long-term retention in care of those patients on treatment. Growing awareness of the negative consequences of late presentation for treatment, combined with new enthusiasm for test-and-treat strategies, is now leading to renewed interest in the pre-ART period, which is after HIV diagnosis but before treatment. Our analysis of 24 studies documenting rates of retention of patients from testing positive for HIV infection to initiating ART suggests that patient management during this period poses serious challenges. Most studies reported a substantial reduction in patient numbers at every step of the process. This reduction in patient numbers is clearly illustrated in Figure 6, which summarizes findings from all the reports. Studies are few, however, and offering a definitive answer to our core question—what proportion of patients who test positive for HIV are staged, enroll and remain in pre-ART care until ART eligibility, and initiate ART—is not possible with the data available. Only a handful of countries are represented, and most by no more than one or two studies. No study provides all the information needed to answer this question, even for a single setting, and combining results from multiple studies appears ill-advised. To examine the implications of doing this, we multiplied the median proportions of patients achieving the study end point in each stage (Stage 1, 59%; Stage 2, 46%; Stage 3, 68%), and found that the information available suggests that only about 18% of patients who are not yet eligible for ART when they are diagnosed with HIV remain continuously in care until ART eligibility. When we instead multiplied all combinations of estimates from each of the three stages, we estimated a median completion of all three stages of 17%, with an interval from the 10th to the 90th percentile of 7%–32%. 10.1371/journal.pmed.1001056.g006 Figure 6 Summary of proportions of patients completing steps within each stage of pre-ART care in the studies reviewed. If we make one optimistic assumption, we can use the data in the most complete study in our review—SA 6, which tracked patients from provision of a sample for a CD4 count to either ART initiation or a repeat CD4 count—to answer the question for one setting. In SA 6, 988 patients were enrolled after testing positive for HIV. By the end of the study, 141 had initiated ART, and 189 had returned for at least one repeat CD4 count. If we optimistically assume all 189 in the latter group remained in pre-ART care until ART initiation, then the overall retention rate for this population was 33%, better than what we estimated by multiplying the medians but still very low. While it is difficult to believe that only a sixth to a third of patients remain continuously in care, the evidence does not allow us to make a more definitive estimate. There appear to be several main reasons for the poor performance of pre-ART care in retaining patients. Most patients during this stage are asymptomatic and may not perceive themselves as requiring medical care. Since very little therapeutic care is offered during the pre-ART period, patients must take it on faith that making the effort to come to the clinic for monitoring is worth the costs of doing so. Current approaches to providing care often require multiple clinic visits, for example, to first provide a blood sample for a CD4 count and then return a week later to receive the results. Choosing to “wait and see what happens” may well be a preferred strategy for patients who lack resources for transport, risk losing employment by taking time off work, or fear being recognized as a client of an HIV clinic. Other patients, those who already have very low CD4 counts at their first presentation for HIV care, do not complete Stage 3 because they die before doing so. A number of the papers we reviewed stratified results by CD4 count range and/or identified other factors associated with pre-ART attrition, and a review of these findings would be valuable. In interpreting the results summarized above, it should also be kept in mind that there is far more mobility among HIV patients than had been anticipated [8]. Loss to follow-up at any one site may or may not indicate that a patient has dropped out of care permanently. Some patients may have returned to the same site after the data for the study were censored or the study's definition of loss to care reached. Many patients may have simply transferred, usually informally, from one site to another. Difficult as this problem is for managing ART patients, it is even worse during the pre-ART period, because patients are expected to visit the clinic less frequently, and more clinics are able to provide pre-ART services than are accredited to offer ART. For individual patients, dropping out of pre-ART care is less likely to represent a death sentence than is loss to follow-up after initiating treatment. Patients lost to pre-ART care mainly risk becoming late presenters to treatment, not dying. It is reasonable to assume that many, if not most, patients who drop out of pre-ART care will return to the health-care system at some later date, most likely once they become seriously ill. Without an effective health information system that allows patients to be tracked from site to site and over time, as they come and go from care, it is nearly impossible to assess the extent to which patient mobility mitigates the observed loss to care rates. While pre-ART loss to care may not pose as immediate a mortality threat as loss of patients who already have clinical AIDS, it is still a major impediment to improving the outcomes of HIV care and treatment overall, is itself a contributor to the high mortality observed during the first year on ART, and wastes scarce health system resources. What can be done to begin to address this problem? We have heard of several operational solutions currently being evaluated, involving adjustments in referral procedures, improvements in the information provided to patients, reminders conveyed by text message or phone, or an increase in the number of steps that can be completed in a single visit. We have seen few rigorous evaluations of interventions, however. One exception, which is currently being evaluated in several settings, is the use of point-of-care CD4 count technology to reduce the number of visits to the clinic in Stage 1 [9]–[13]. Another promising strategy is to dispense prophylaxis for opportunistic infections, such as cotrimoxazole and isoniazid, more actively to pre-ART patients; a study in Kenya reported that retention of pre-ART patients 12 mo after enrollment improved from 63% to 84% after provision of cotrimoxazole was introduced [14]. Research Priorities A discussion of interventions is beyond the scope of this paper but would warrant further investigation. What we do wish to discuss are two issues that arise directly from this review. First, the review made painfully clear the need for standardization of terminology, definitions, time intervals, and end points that should be reported for the pre-ART period. The three-stage structure presented here may provide a framework for classifying results, but it is no more than a starting point. We have three recommendations for how researchers might begin to address this issue. First, proposals for clearly defined outcomes within each stage, and standard terminology to describe those outcomes and to label the phenomenon of pre-ART loss to care overall, would be helpful. Suggestions from researchers involved in work in this area, and thus familiar with data availability and limitations, would be welcome. Second, more effort should be made to report quantitative data comprehensively. We were forced to exclude from our review one paper and several conference abstracts that indicated that the authors likely had the data required to make quantitative estimates of retention in pre-ART care but did not report them or reported them incompletely. Having a standard set of indicators and outcomes, as suggested above, would also help to solve this second problem. And third, using data censoring as an end point should be avoided when possible, in favor of a clinically meaningful end point or a fixed duration of follow-up. The second issue highlighted by this review is the absence of health information systems that allow patients to be tracked between service delivery points. We did not find a single study that was able to follow a cohort of HIV-positive adults all the way from testing to treatment initiation if they were not already eligible for ART when diagnosed. While in retrospect this points to a failure of the research community to establish prospective cohorts several years ago, it also reflects the sheer difficulty posed by such research. In most settings we are familiar with, it is virtually impossible to determine retrospectively what happens to patients after testing positive for HIV, as there is no tracking system in place to indicate whether they have sought further care or not. In our experience, even where sophisticated electronic record systems are in use for managing ART patients, they are rarely kept up to date or complete for those who have not initiated ART. A starting point for understanding the nature and scope of the problem of pre-ART loss to care might thus be to implement effective patient tracking systems in selected geographic catchment areas that will generate accurate information on attrition between and within stages and help researchers assess the role of patient mobility in offsetting observed attrition, identify characteristics of patients most likely to be lost, and explore the extent to which attrition from pre-ART care is temporary—i.e., delay in action by patients who will later return to care, albeit sicker—or represents permanent loss from the health-care system, which will likely ultimately lead to death. Even doing this on a relatively small scale will be challenging, as it has been for ART patients [15], but it is a vital intervention for improving pre-ART care. Limitations and a Call for Data The heterogeneity of the literature identified, and the sheer scarcity of studies found for most sub-Saharan countries, led to a number of review limitations that are important to bear in mind in interpreting our findings. Most of these limitations have been alluded to already but warrant reiteration here. First, the quality and heterogeneity of the studies prevented meaningful synthesis of the results, which should therefore be regarded as suggestive rather than conclusive. The lack of standard definitions among reports, or even clear definitions of outcome measures within some (but not all) of the reports, combined with inconsistent or unreported durations of follow-up, stymied aggregate analysis. This limitation should be kept in mind in interpreting the forest plots and the summary figure (Figure 6) in particular. Second, double-counting likely affects some of the studies. Patients who are lost from one stage of care can return to care later and either successfully complete the stage or be lost again. Single-stage studies can tell us whether patients remain continuously in care until the end of the stage but should not be combined with studies of other stages, as demonstrated by our multiplying of median estimates above. Third, there is likely important heterogeneity among study populations that could not be discerned from most reports. For example, patients who enroll in pre-ART care (Stage 2) with low CD4 counts, close to the ART eligibility threshold, have less time at risk of being lost from care than those who enroll earlier, with higher CD4 counts, but few studies reported this information. Fourth, half of the studies eligible for inclusion in our review came from just one country, South Africa, and only six other countries are represented by the rest of the studies. This may diminish the generalizability of the findings to the sub-Saharan region as a whole. Fifth, eight of the 28 studies included were in abstract form only and were thus not subjected to peer review. Finally, publication bias may have affected our summary estimates. Only a few HIV clinics in sub-Saharan Africa have published information about pre-ART loss to care, and most of these sites collaborate with nongovernmental organizations, universities, or other external partners. If sites that have the ability and resources to report on such data have either lower or higher than average retention rates, our summary estimates will be biased. Needless to say, new health information systems or studies launched now—the best solution to the problems described above—will require several years to accumulate the duration of follow-up needed. We therefore conclude with a call to HIV/AIDS service delivery organizations in the field. We think it likely that some programs have captured the data needed to analyze pre-ART loss to care through all three stages. We speculate that in some geographic areas, a single organization is the sole provider of every step of HIV care and treatment delivery. If that organization has also assigned a unique patient identification number to all those served, beginning with HIV testing, then an adequate data set may exist. We hope that this paper will inspire those who may have such data to try to answer the questions raised here, and that we will soon begin to see the results of this effort in the literature. Supporting Information Text S1 Search protocol. (DOC) Click here for additional data file. Text S2 PRISMA checklist. (DOC) Click here for additional data file.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            High HIV testing uptake and linkage to care in a novel program of home-based HIV counseling and testing with facilitated referral in KwaZulu-Natal, South Africa.

            For antiretroviral therapy (ART) to have a population-level HIV prevention impact, high levels of HIV testing and effective linkages to HIV care among HIV-infected persons are required. We piloted home-based counseling and testing (HBCT) with point-of-care CD4 count testing and follow-up visits to facilitate linkage of HIV-infected persons to local HIV clinics and uptake of ART in rural KwaZulu-Natal, South Africa. Lay counselor follow-up visits at months one, three and six evaluated the primary outcome of linkage to care. Plasma viral load was measured at baseline and month six. 671 adults were tested for HIV (91% coverage) and 201 (30%) were HIV-infected, of which 73 (36%) were new diagnoses. By month three, 90% of HIV-infected persons not on ART at baseline had visited an HIV clinic and 80% of those eligible for ART at baseline by South African guidelines (CD4≤200 cells/μL at the time of the study) had initiated ART. Among HIV-infected participants who were eligible for ART at baseline, mean viral load decreased by 3.23 log10 copies/mL (p<0.001) and the proportion with viral load suppression increased from 20% to 80% between baseline and month six. In this pilot of HBCT and linkages to care in KwaZulu-Natal, 91% of adults were tested for HIV. Linkage to care was ∼90% both among newly-identified HIV-infected persons as well as known HIVinfected persons who were not engaged in care. Among those eligible for ART, a high proportion initiated ART and achieved viral suppression, indicating high adherence and reduced infectiousness.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Identification of Mutations in the PYRIN-Containing NLR Genes (NLRP) in Head and Neck Squamous Cell Carcinoma

              Head and Neck Squamous Cell Carcinoma (HNSCC) encompasses malignancies that arise in the mucosa of the upper aerodigestive tract. Recent high throughput DNA sequencing revealed HNSCC genes mutations that contribute to several cancer cell characteristics, including dysregulation of cell proliferation and death, intracellular proinflammatory signaling, and autophagy. The PYRIN-domain containing NLR (Nucleotide-binding domain, Leucine rich Repeats – containing) proteins have recently emerged as pivotal modulators of cell death, autophagy, inflammation, and metabolism. Their close physiologic association with cancer development prompted us to determine whether mutations within the NLRP (PYRIN-containing NLR) gene family were associated with HNSCC genome instability and their clinicopathologic correlations. Catastrophic mutational events underlie cancer cell genome instability and mark a point-of-no-return in cancer cell development and generation of heterogeneity. The mutation profiles of 62 patients with primary conventional type HNSCC excluding other histologic variants were analyzed. Associations were tested using Fisher's Exact test or Mann-Whitney U test. Mutations in NLRP were associated with elevated genome instability as characterized by higher mutation rates. Clinically, NLRP mutations were more frequently found in HNSCC arising in the floor of mouth (50.0%) in comparison with HNSCC at other head and neck locations (14.8%). These mutations were clustered at the leucine rich repeats region of NLRP proteins, and affected NLRP genes were mostly localized at chromosomes 11p15.4 and 19q13.42-19q13.43. Twenty novel NLRP mutations were identified in HNSCC, and mutations in this group of genes were correlated with increased cancer cell genome mutation rates, and such features could be a potential molecular biomarker of HNSCC genome instability.
                Bookmark

                Author and article information

                Journal
                Bull World Health Organ
                Bull. World Health Organ
                BLT
                Bulletin of the World Health Organization
                World Health Organization
                0042-9686
                1564-0604
                01 September 2015
                25 June 2015
                : 93
                : 9
                : 623-630
                Affiliations
                [a ]Médecins Sans Frontières (MSF), Southern Africa Medical Unit (SAMU), Waverly Business Park, 303 A&B, Cape Town, South Africa.
                [b ]MSF, Operational Centre Amsterdam, Netherlands.
                [c ]MSF, Operational Centre Paris, France.
                [d ]MSF, Epicentre Paris, France.
                [e ]MSF, Operational Centre Brussels, Belgium.
                [f ]MSF, Khayelitsha, South Africa.
                [g ]MSF, Roma, Lesotho.
                [h ]MSF, Diagnostic Network, Amsterdam, Netherlands.
                [i ]MSF, Access Campaign, Geneva, Switzerland.
                Author notes
                Correspondence to Emmanuel Fajardo (email: emmanuel.fajardo@ 123456joburg.msf.org ).
                Article
                BLT.14.146480
                10.2471/BLT.14.146480
                4581638
                054d94aa-43ed-4e99-aac0-6c5c652e00f4
                (c) 2015 The authors; licensee World Health Organization.

                This is an open access article distributed under the terms of the Creative Commons Attribution IGO License ( http://creativecommons.org/licenses/by/3.0/igo/legalcode), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. In any reproduction of this article there should not be any suggestion that WHO or this article endorse any specific organization or products. The use of the WHO logo is not permitted. This notice should be preserved along with the article's original URL.

                History
                : 31 August 2014
                : 14 May 2015
                : 21 May 2015
                Categories
                Research

                Comments

                Comment on this article

                scite_

                Similar content87

                Cited by14

                Most referenced authors355