Sensitivity and specificity of five malaria rapid diagnostic kits used in south-south region of Nigeria ()
1. INTRODUCTION
Malaria is an acute systemic illness caused by infection with Plasmodia species all of which are transmitted to humans by female Anopheles species mosquitoes. Malaria remains one of the leading causes of morbidity and mortality with an estimated 300 to 800 million clinical cases of malaria and 1 to 3 million deaths due to malaria annually in the tropics and subtropics [1]. Malaria kills 1 child every 30 seconds and 3000 children less than 5 years every day [2]. Malaria is the most significant public health problem in Nigeria. It accounts for 25% of under-5 mortality and 30% childhood mortality and 11% maternal mortality [2]. At least 50% of the population will have at least one episode of malaria annually while children that are aged below 5 years (about 24 million) will have 2 to 4 attacks of malaria annually [3]. Malaria is currently endemic in more than 100 countries worldwide, which in return are visited by more than 125 million travelers annually. P. falciparum is found in subSaharan Africa, Southeast Asia, and the Indian subcontinent as well as in South America, Haiti, the Dominican Republic, Jamaica (where isolated cases have been recently reported), and areas of Oceania [4]. P. malariae and P. ovale are present in sub-Saharan Africa. P. vivax is prevalent in areas of Southeast Asia, the Indian Subcontinent, and Central and South America [4].
Prompt and accurate diagnosis is key to effective management of malaria. Due to its global impact, the development of diagnostic strategies, that will be effective not only in resource-limited area, where malaria has large burden on society, but also in developed nations, where expertise in malaria diagnosis is often lacking, should be encouraged [5,6]. In order to prevent morbidity and mortality, accurate diagnosis of malaria is necessary which will also reduce the misuse of antimalaria. New rapid diagnostic techniques have been developed and evaluated widely in recent years, but the rapid introduction, withdrawal, and modification of commercially available products, variable quality control in manufacturing; and potential decrements in test performance related to the stability of stored test kits have rendered these review largely obsolate [7-9].
There is characteristic requirement for a rapid Malaria Diagnostic Test (MRDT) which vary based on regional malaria epidemiology and the goal of malaria control program [10]. The primary goal of Malaria Rapid Diagnostic Tests (MRDTs) should require minimal operator training and yield highly reproducible test interpretation. This method is also seen as a point of care testing which can be done at the bed side of the patient while the physician is actively managing the patient. Though this might not be achievable in all cases, it had been made it clear that the ideal test technique should be able to detect a response to therapy, including detection of recrudescenced or relapse, and stability of its components should be such that refrigeration and cold chain are not needed [11].
The use of malaria rapid diagnostic test kits in our laboratories is on the increase. consequently there is need for the evaluation of this kits. Although data exist on the comparison of serological testing procedures of malaria and microscopy [12], none have focused on the sensitivity and specificity of thses rapid test kits in Nigeria. Against this background this study was aimed at determining the sensitivity and specificity of five malaria rapid kits commonly in Nigeria.
2. MATERIALS AND METHODS
2.1. Study Area
This work was carried out at Igbinedion University Teaching Hospital, Okada, in Ovia North East Local Government Area of Edo State, between the months of April - August 2011, a period that coincides with the rainy season in Nigeria. Okada a rural community is the headquaters of Ovia North East Local Government Area of Edo State which has an estimated population of 155,344 persons [13]. Majority of the dwellers are farmers and traders. Less than 10% of the population is formed lecturers and students.
2.2. Selected Kits
The kits used in this study were the most commonly used and most available in the Nigerian market. The kits are; Plasmotest (Biotech International, Germany), Malariatest (Acon Diagnostic, USA), AcumPF (Acumen, China), PF test (Diaspot, Indonesia) and Malaria P.f. (Global, USA).
2.3. Study Population
Blood samples of 200 patients comprising of (100 children and 100 adults), confirmed for the presence of malaria parasite using microscopy method at the Igbinedion University Teaching Hospital, Okada, and were used for this study. A further 200 subjects comprising of (100 children and 100 adults) that were negative for malaria parasite also recruited and served as control. The study was conducted between July and September 2011. Verbal consent was gotten from participating adult subjects, and guardians/wards in cases of children. The etical committee of the Igbinedion University Teaching approved this work.
2.4. Sample Collection
Three milliliters (3 ml) of venous blood was collected from each patient and control subject and dispensed into an Ethylene diamine tetra-acetic acid (EDTA) container and gently mixed. The samples were taken immediately to the laboratory for processing.
2.5. Gold Standard Preparations
Thick film examination/Parasites count
Thick films were made from the anti-coagulated blood, allowed to dry and stained using Giemsa stain [14]. The blood films were examined under ×100 microscope objective lens for morphological features of Plasmodium sp. 100 positive samples and negative sample were used as gold standard.
Parasite density was carried out using standard formulae for parasites count as described by Cheesbrough [14].
2.6. Serological Testing
The serological diagnosis was carried out using; Plasmotest (Biotech International, Germany), Malariatest (Acon Diagnostic, USA), AcumPF (Acumen, China), PF test (Diaspot, Indonesia) and Malaria P.f. (Global, USA) following the instructions provided by the manufacturers. Except for Acon that is lateral flow others were flow through.
2.7. Diagnostic Sensitivity and Specificity
The diagnostic sensitivity and specificity were determined according to World Health Organization Standard [15]. All tests were performed according to the manufacturer’s recommendation.
3. RESULTS
This study was carried out using 400 blood samples. Two hundred samples were positive by microscopic method and were grouped as positive gold standard. The remaining 200 samples were labeled negative gold standard after they have been confirmed by microscopy. The positive gold standard made up of 100 positive samples from children and 100 positive samples from adults (Tables 1 and 2).
Table 1. Sensitivity and specificity of the test kit with children samples.
Table 2. Sensitivity and specificity of the test kit on samples of adult patients.
Table 3. Comparison between sensitivity and specificity of the five MRDT’s to adult and children sample.
Table 4. Malaria parasite load in positive gold standard blood sample from children and adult.
The sensitivity and specificity of the test kits using children sample revealed that Biotech had a sensitivity and specificity of 96% and 99% respectively, Acon had a sensitivity and specificity of 97% and 98%, Diaspot, 98% sensitivity and 97% specificity (Table 1).
The sensitivity and specificity of the test kits using adult sample revealed that Biotech had a sensitivity and specificity of 30% and 99% respectively, Acumen had a sensitivity and specificity of 78% and 97%, Diaspot, 75% sensitivity and 96% specificity (Table 2). There was significant difference in sensitivity of the kits to adult sample compared with children sample (P < 0.05) (Table 3).
Thirty six percent (36%) of children and 19% of adult had parasite load above 6000 parasite/µl, 34% (children) and 41% (adult) had the parasite load ranging between 601 and 6000 while 30% and 40% of children and adult respectively had parasite load less than 600 parasite/µl (Table 4).
The accuracy of the five MRDT’s evaluated using children blood were found to be 0.975 except for Acumen having 0.980 accuracy (Table 5). Biotech also had the lowest false posive rate of 0.01 as in children sample but false negative rate increased from 0.04 in childrens sample to 0.70 in adult. Generally, higher false negative rate were found in adult sample. Each of the kits have different accuracy but Acumen still remain the Kit with the highest accuracy of 0.875 (Table 6).
4. DISCUSSION AND CONCLUSION
In order to alleviate the expanding impact of malaria across the globe, as well as its associated increasing drug resistance, establishment of prompt and accurate diagnosis is required. Microscopy has been seen as gold standard for malaria diagnosis especially in under developed nation, but in recent years, a number of new techniques have become available for the diagnosis of malaria infection. Since the World Health Organization (WHO) recognized the urgent need for new, simple, quick, accurate, and cost-effective diagnostic tests for determining the presence of malaria parasites, to overcome the deficiencies of light microscopy, numerous new malaria-diagnostic techniques have been developed [16]. One of the techniques is the Malaria Rapid Diagnostic Technique its low complexity invites their use by people without formal medical laboratory training for self-diagnosis suggested that HRT-2 based RTD’s can be employed successfully by village volunteers with minimal training [17]. However, in this part of the nation where the climatic conditions and environment favour the malaria vector (Anopheles mosquito), there is need for urgent diagnosis, of which MRDT’s tends to provide. This present study demonstrated a variation in sensitivity of the MRDT’s to adult and children with malaria infection. Unlike previous analysis done by Gasser and his colleagues [18], which they reported that there is no significant difference in sensitivity of the test kit as par age difference. Our present findings revealed that the kits are more sensitive in children malaria compared to adults. For instance, Acumen which shows the highest sensitivity of 99% in children had 78% sensitivity with adult blood sample of positive gold standard Furthermore, it was found out that the detection rate of other rapid Malaria Kit which is an antigen test had a higher performance in children than in adult. This finding is in accordance with the work of Tatfeng and Bawo [19] who reported that rapid Malaria Combo Diagnostic Kit had higher sensitivity in children than adults. The variation in the sensitivity of this test kits with the age variation may be partially accredited to the fact that the test kit detect malaria parasite antigen rather than antibody. And it has been documented that malaria develop faster in children compared to adults due to the fact that the children erythrocytes are rich in haemoglobin [19].
Table 5. Performance of kits against positive and negative gold standards children blood sample.
Table 6. Performance of kits against positive and negative gold standards adult blood sample.
The specificity of the test kits were not affected by age. For instance, Biotech shows 99% specificity and Acon 98% sensitivity in adults and children. The Biotech shows highest specificity but poorly sensitive to adult malaria 30%. The reduction in sensitivity of the test kits may be due to the fact that all the kits tested were only made for the detection of P. falciparum which is the predominant malaria parasite in Nigeria some few cases of P. vivax infection which our thick film only show as malaria parasite since the method cannot differentiate species. The reduction in sensitivity of some of these kits may also be due to long storage they experience while shipping them down to the country since they are not being produced here. Base on genetic variation of the P. faciparum, there is possibility that some of the false negatives are primarily due to genetic modification of the Plasmodium. The low level or absence of HRP-2 secretion by sexual forms may explain the negative results in some cases [20].
Since Nigeria is one of the countries strongly affected by these deadly diseases, a large meta-analysis of rapid tests for malaria may be effective adjuncts to microscopy in centers without expertise in tropical medicine but that expert microscopy is still needed for species identification and confirmation. Conclusively, considering the increasing influx of MRDT’s into the country, and from the result obtained from this study, there is need for control agencies such as National Agency for Food and Drug Administration and Control (NAFDAC) as well as Standard organization of Nigeria (SON) to ensure that diagnostic test kits be reevaluated before introduction into Nigeria market.