Economic evaluation of delivering Haemophilus influenzae type b vaccine in routine immunization services in Kenya
Angela Oloo Akumua, Mike Englisha, J Anthony G Scottb, Ulla K Griffithsc
Haemophilus influenzae type b (Hib) vaccine has been licensed for use in infants since 1991. Most industrialized countries introduced the vaccine quickly into routine infant immunization services. This was justified by observed annual incidence rates of Hib meningitis between 20 and 69 cases per 100 000 children under five years old.1 Middle-income and developing countries have been hesitant to introduce the vaccine because of its relatively high price and the problem of establishing the Hib disease burden in areas with very little surveillance. However, since 2001 the GAVI Alliance (previously the Global Alliance for Vaccines and Immunization) has provided financial support for new and underused vaccines in 72 low-income countries.2 By July 2005, GAVI supported the introduction of Hib vaccine in 17 of these countries, usually delivered in combination with diphtheria-tetanus-pertussis (DTP) and hepatitis B vaccines as a pentavalent vaccine.2
Kenya was among the first nine countries to receive financial support from GAVI, and pentavalent vaccine was introduced nationwide in November 2001. GAVI’s financial commitment for new vaccines in Kenya was US$ 67.4 million over a five-year period,2 after which it was anticipated that the vaccine price would decrease substantially – an expectation yet to be realized. Support was planned to end in 2006, but recently GAVI offered to extend assistance through 2006–2015 with country co-financing. GAVI’s phase II strategy is that recipient countries make progressive increases to their contributions to vaccine costs so that they reach market prices by 2016.3 In 2007 the Kenyan Government agreed to co-finance the pentavalent vaccine with US$ 0.38 per dose for the period 2006-2011 (letter from Minister of Health to GAVI, 18 April 2007). Hib vaccination is a new cost item in the Kenyan Government’s health budget; therefore cost-effectiveness evidence is likely to be crucial when deciding on future financial support. The objective of this study was to estimate the incremental costs per case, death and DALY, averted by delivering Hib vaccine in routine infant immunization services in Kenya.
A model was developed to follow the 2004 birth cohort until death. Two scenarios were constructed: one with Hib vaccine in routine immunization services and one without. Only immediate costs of care were estimated, excluding the costs of providing long-term care for patients with severe sequelae. The analysis was carried out from a public health provider perspective; costs incurred by households were not included. The 2004 average exchange rate of 79.49 Kenyan shillings to US$ 1 was used in all calculations. All future costs and outcomes were discounted at 3% per year.
Hib disease incidence
Pneumonia is the most common manifestation of Hib disease in developing countries.4 Findings from Hib vaccine trials in the Gambia and Chile illustrate that reductions in radiologically proven pneumonia cases were approximately five times those in Hib meningitis cases.5–7 However, difficulties in establishing a definitive diagnosis of Hib disease in most parts of the world mean that the true disease burden remains largely unknown.4,8 Hib disease is divided into three categories in this study: (a) Hib meningitis, (b) non-meningitic invasive Hib disease (mainly bacteraemic Hib pneumonia, but also severe sepsis with an unknown focus of infection), and (c) non-bacteraemic Hib pneumonia.
Age-specific incidences of category (a) and (b) before and after the introduction of Hib vaccine were estimated from hospital admission records at Kilifi District Hospital (KDH) between 2000 and 2005. KDH is a rural government-funded hospital with 42 paediatric beds and approximately 5000 paediatric admissions per year. A Kenya Medical Research Institute (KEMRI) centre at the hospital has been conducting research on common childhood illnesses since 1989. Data on paediatric invasive bacterial infections, including routine blood cultures on all children admitted to hospital, have been collected since 1998.9 Cases of Hib invasive disease were categorized as meningitis if a cerebrospinal fluid (CSF) specimen yielded a positive Hib culture, a positive Hib antigen test, or had an elevated CSF white cell count in the presence of a blood culture positive for Hib. If a positive blood culture was the only evidence of Hib disease, the case was classified as non-meningitic invasive Hib disease.10 Detailed criteria for detecting meningitis cases, collecting specimens and laboratory processing at KDH have been published elsewhere.9,11
Since 2000, KEMRI has conducted a demographic surveillance study (DSS) in an 891 km² area around the hospital: 25 000 households are visited and re-enumerated every six months. Hib cases admitted to KDH from within the DSS area were linked to age-specific population denominators to estimate annual incidence rates of invasive Hib disease detected by passive hospital surveillance.11 The hospital incidence of Hib invasive disease per 100 000 children aged < 5 years was 66 (95% confidence interval, CI: 49.6–81.6) before the introduction of Hib vaccine (2000/2001) and 7.6 (95% CI: 1.6–22.3) three years after its introduction (2004/2005).11 However, these estimates underestimate the true incidence, as a relatively large proportion of children in Kenya have limited access to health care and therefore would not be detected by hospital surveillance. Even within the Kilifi DSS, the area closest to the hospital, only one-third of childhood deaths occur in hospital, and one-third of children who die access only primary health-care facilities during their terminal illness.12,13 These findings are consistent with data from rural communities elsewhere in Kenya.14 Based on these data, and adopting a conservative approach to take account of better access in urban communities, we estimated that 50% of Hib disease cases were detected by passive hospital-based surveillance. The true incidence of Hib invasive disease in children aged < 5 years was therefore calculated as twice that observed in the Kilifi study (Table 1).
Non-bacteraemic Hib pneumonia was not included in the surveillance at KDH as currently there is no diagnostic tool other than blood culture to determine accurately the etiology of pneumonia.8 The incidence of category (c) was therefore estimated from the 5:1 ratio between Hib meningitis and pneumonia referred to above. The incidence of disease category (b) was subtracted to avoid double-counting of bacteraemic pneumonia. Case fatality rates were varied according to the type of health care received, as summarized in Table 1.
Disability adjusted life years (DALYs) were estimated using the method recommended in the 1996 global burden of disease study.15 Age weighting was included. The disability weight is 0.616 for the acute phase of bacterial meningitis and 0.28 for an episode of non-meningitic invasive Hib disease and non-bacteraemic pneumonia.15 For survivors, we assumed that all episodes last one month. At KDH, 25% of Hib meningitis survivors suffer from clinically obvious significant neurological sequelae, predominantly motor deficits.16 Therefore, we applied the disability weight for motor deficits (0.334) to meningitis sequelae and assumed that the sequelae last throughout the patients’ lives. More minor sequelae (such as epilepsy) and even major non-motor sequelae (such as isolated sensorineural deafness) were not accounted for.
Table 1. Parameters for estimating burden of Hib disease in Kenya before and after vaccine introduction
Vaccine delivery costs
The current costs of including pentavalent vaccine in the routine immunization schedule were compared to a hypothetical scenario using the diphtheria-tetanus-pertussis-hepatitis B combination without Hib vaccine. As all vaccines and injection equipment are procured through the United Nations Children’s Fund (UNICEF), we used the 2004 vaccine and syringe prices of the UNICEF supply division.17 Other vaccine delivery costs, such as staff salaries and transport, were not included. These would not be affected markedly as there is no difference in the number of health service contacts for the two different types of vaccines. Ministry of Health staff members were interviewed in order to assess other costs related to vaccine introduction, such as enhanced surveillance and training activities.
Hib disease treatment costs
Hospital treatment costs were divided into patient-specific costs and costs per patient bed-day. Patient-specific costs of Hib meningitis and non-meningitic invasive Hib disease were estimated from patient records at KDH. We reviewed the hospital records of 31 children admitted in 2001 with proven invasive Hib disease (21 meningitis and 10 non-meningitic invasive disease) and extracted information on diagnostic tests, drugs administered and the length of hospital stay. Data from the six children who died were included in the analysis. However, as KDH is a research setting, certain diagnostic tests and treatment procedures differ from standard Kenyan practices. To avoid inflating the national cost estimates we substituted KDH costs for third-generation cephalosporins, not currently recommended as first-line antibiotic therapy in Kenya, with costs for penicillin and chloramphenicol, and excluded blood culture costs. For non-bacteraemic Hib pneumonia, patient-specific data on resource usage were collected from a total of 76 pneumonia patient records at three district hospitals: Homa Bay, Kitui and Kerugoya.
Unit costs for drugs were collected largely from the Kenya Medical Supplies Agency (KEMSA). Costs per bed-day and per outpatient visit were taken from the WHO-CHOICE database.18 We used cost data for a secondary hospital, as we believe this provides the best average cost estimate for a national-level analysis. In 2004 values, the costs per bed-day and per outpatient visit were US$ 6.57 and US$ 1.92 respectively. The assumptions on access to care summarized in Table 1 were used to calculate treatment costs for the country as a whole.
Uncertainty and sensitivity analysis
We undertook a probabilistic multivariate analysis to assess the impact of uncertainty in parameter values. Prediction intervals around the mean cost-effectiveness ratios were derived from 50 000 Monte Carlo simulations by Crystal Ball software (Decisioneering, USA). For the disease burden parameters we assumed either triangular or normal distributions with ranges or standard deviations respectively (Table 1). Based on previous patterns19 and the analysis of patient records, a lognormal distribution was assumed for the treatment cost parameters.
One-way sensitivity analyses were undertaken to assess the importance of herd immunity and vaccine price. In the Gambia, invasive Hib disease has been eliminated among children aged < 5 years, despite the fact that the timing and coverage of Hib immunizations predict a direct vaccine protection of only 41%.20 Most of the observed effectiveness is therefore attributable to indirect protection. We included a scenario of zero incidence of Hib disease to illustrate the potential long-term impact. The pentavalent vaccine price was varied to US$ 3 per dose, representing an 18% decrease on the 2004 price. We also calculated the break-even price.
Impact of Hib vaccine on disease incidence
Before the introduction of Hib vaccine, the annual incidence per 100 000 children aged < 5 was estimated at 71 for Hib meningitis, 61 for Hib non-meningitic invasive disease and 296 for non-bacteraemic Hib pneumonia. Three years after the introduction these incidence estimates were 88% lower at 8, 7 and 34 respectively. The estimated number of cases and deaths for the 2004 birth cohort with and without Hib vaccine are shown in Table 2. Without Hib vaccine we estimate that 27 347 children would experience Hib disease, resulting in 6112 deaths. With the introduction of the vaccine these numbers are reduced to 3149 cases and 704 deaths. Thus, over the first five years of life Hib vaccination is preventing 5408 deaths in the 2004 birth cohort (4% of under-five mortality). If children did not receive vaccine but all had access to hospital care at current Kenyan standards, the estimated number of deaths would decrease by 60%, resulting in 2164 deaths prevented by Hib vaccination.
Table 2. Model estimates of cases and deaths from Hib disease with and without Hib vaccine delivery in the 2004 Kenyan birth cohort
Vaccine delivery costs
Costs of vaccine and injection equipment for the six different antigens currently included in the Kenyan immunization schedule are outlined in Table 3, together with the costs of a scenario using a diphtheria-tetanus-pertussis-hep B combination vaccine instead of pentavalent vaccine. The costs of pentavalent vaccine amount to 90% of total vaccine and injection equipment costs. GAVI supported the Kenyan Government with US$ 100 000 to finance training and communication activities for introducing new vaccines. The health ministry did not introduce post-vaccine surveillance for meningitis other than through the externally funded WHO-African Region Paediatric Bacterial Meningitis Surveillance Network, so we did not include additional surveillance costs.
Vaccine and injection equipment costs per fully immunized child are US$ 14.95 for pentavalent vaccine and US$ 7.47 for the diphtheria-tetanus-pertussis-hep B vaccine combination.
Table 3. Estimated annual cost (US$) of vaccines and injection equipment in Kenyan public health sector with and without the pentavalent vaccine (2004)
The mean lengths of stay for meningitis, non-meningitic invasive disease and non-bacteraemic pneumonia patients were 11.7 (standard deviation, SD 6.5), 7.5 (SD 5.7) and 5.7 (SD 5.6) days respectively. The drug costs of Hib meningitis, non-meningitic invasive Hib disease and non-bacteraemic pneumonia were US$ 10 (SD 8), US$ 14 (SD 22) and US$ 3 (SD 3) respectively. Mean total treatment costs were US$ 132 for a case of Hib meningitis, US$ 112 for non-meningitic invasive Hib disease and US$ 48 for non-bacteraemic Hib pneumonia.
With current access to health-care services, total treatment costs saved due to Hib vaccination of the 2004 birth cohort amount to US$ 871 539. This is 12% of Hib vaccine delivery costs. If all Kenyan children had access to hospital care, this figure would be US$ 1 740 769, or 24% of Hib vaccine delivery costs.
In the base case scenario the costs per discounted case, death and DALY averted were US$ 268, US$ 1197 and US$ 38 respectively (Table 4).
Uncertainty and sensitivity analysis
The 95% prediction interval of certainty for the cost per discounted DALY and death averted were US$ 26–63 and US$ 814–2021 respectively (Table 4). Hence, if the Kenyan Government considers an investment that costs US$ 63 per discounted DALY averted to be cost-effective, Hib vaccine can be considered cost-effective with 97.5% certainty.
Fig. 1 illustrates which parameters contribute to most of the uncertainty in the cost-effectiveness ratios. Of the 27 variables with a distribution and an uncertainty range in the analysis, five caused 96% of the variability in the costs per discounted DALY averted estimate. Three of these are access to care parameters. Since the access to hospital care parameter affects the disease incidence and the case fatality rates, uncertainty in this parameter causes 44% of the uncertainty. Hence, more knowledge about access to care is required in order to obtain a more precise cost-effectiveness estimate.
Assuming that herd immunity would lead to the elimination of Hib disease, the cost-effectiveness ratio decreases to US$ 1041, US$ 233 and US$ 33 per discounted death, case and DALY averted, respectively. With a pentavalent vaccine price of US$ 3 per dose, the incremental costs per discounted death and DALY averted are US$ 774 and US$ 24 respectively. The break-even pentavalent vaccine price per dose, where incremental Hib vaccination costs equal averted treatment costs for Hib disease, is US$ 1.82. Hence, a price lower than this for Hib vaccination provides government health sector savings.
The most pressing question faced by health policy-makers in Kenya is whether Hib vaccine is a priority deserving public funds. The decision should be based on the affordability and estimated cost-effectiveness of the vaccine. We have found that the costs per discounted DALY averted are in the range of US$ 26–63 at the current vaccine price. By all generally used benchmarks, this is considered a highly cost-effective intervention. WHO suggests that an intervention may be considered very cost-effective if the costs per discounted DALY averted are less than the country’s per-capita GDP.21 Hib vaccination easily falls below this benchmark – the per capita GDP was US$ 481 in 2004.
A cost-effectiveness analysis is relative in the sense that one intervention can only be considered cost-effective in relation to another. However, there is little cost-effectiveness information on other interventions in Kenya for comparison. The cost-effectiveness of Hib vaccine is comparable to preventive interventions against malaria, such as bednets (US$ 4–85 per discounted DALY)22 and to some tuberculosis control strategies (US$ 13–496 per discounted DALY).23
Our estimates of Hib disease incidence, with and without vaccine, are derived from a study monitoring its decline in a largely rural district. The only plausible explanation for this is the provision of Hib vaccine as part of the government’s routine immunization programme.11 The vaccine’s impact was measured from a hospital setting; low levels of access to care produce an underestimate of the true disease burden. By adjusting the hospital incidence estimates for access to care, we generated a considerably higher vaccine impact. We believe our estimate of the proportion of children having access to inpatient care (50%) is conservative given the available data.14 There are several other reasons why the cost-effectiveness results are likely to be underestimates. First, the case fatality rate attributed to inpatient Hib meningitis (17%) is considerably lower than the average reported for sub-Saharan Africa (27.6%).1 Second, we account only for serious motor sequelae in children with meningitis and not those with other invasive Hib disease. Third, the cost-effectiveness estimates include only the provider’s perspective and do not take into account costs borne by households.
Many people in low-income countries consider Hib disease to be relatively uncommon and expensive to prevent. Our findings indicate that while the burden of disease is smaller than for diseases such as malaria, so too is the investment required to prevent the disease. Thus, Hib vaccine is as cost-effective as any other priority intervention: each life saved requires an investment similar to that required for impregnated bednets to prevent malaria. This analysis should encourage action in countries that have delayed introducing the vaccine into their immunization schedule because the costs did not appear to be matched by the benefits. The findings indicate to manufacturers and donors that a small decrease in vaccine price markedly improves its cost-effectiveness and that pentavalent vaccine would be affordable by all if its price was halved. ■
- Bennett JV, Platonov AE, Slack MPE, Mala P, Burton AH, Roberson SE. Haemophilus influenzae type b (Hib) meningitis in the pre-vaccine era: a global review of incidence, age distributions, and case-fatality rates. Geneva: WHO; 2002.
- Estimated five-year commitment in US$ to 72 countries (July 2005). Geneva: Global Alliance for Vaccines and Immunization; 2005. Available at: www.vaccinealliance.org/support_to_country/country_status/index.php
- Bridge financing investment case. Geneva: GAVI; 2005.
- H Peltola. Worldwide Haemophilus influenzae type b disease at the beginning of the 21st century: global analysis of the disease burden 25 years after the use of the polysaccharide vaccine and a decade after the advent of conjugates. Clin Microbiol Rev 2000; 13: 302-17.
- K Mulholland, S Hilton, R Adegbola, S Usen, A Oparaugo, C Omosigho, et al. Randomised trial of Haemophilus influenzae type-b tetanus protein conjugate vaccine [corrected] for prevention of pneumonia and meningitis in Gambian infants. Lancet 1997; 349: 1191-7.
- OS Levine, R Lagos, A Munoz, J Villaroel, AM Alvarez, P Abrego, et al. Defining the burden of pneumonia in children preventable by vaccination against Haemophilus influenzae type b. Pediatr Infect Dis J 1999; 18: 1060-4.
- K Mulholland, O Levine, H Nohynek, BM Greenwood. Evaluation of vaccines for the prevention of pneumonia in children in developing countries. Epidemiol Rev 1999; 21: 43-55.
- T Cherian. Describing the epidemiology and aetiology of bacterial pneumonia in children: an unresolved problem. J Health Popul Nutr 2005; 23: 1-5.
- JA Berkley, BS Lowe, I Mwangi, T Williams, E Bauni, S Mwarumba, et al. Bacteremia among children admitted to a rural hospital in Kenya. N Engl J Med 2005; 352: 39-47.
- JA Berkley, K Maitland, I Mwangi, C Ngetsa, S Mwarumba, BS Lowe, et al. Use of clinical syndromes to target antibiotic prescribing in seriously ill children in malaria endemic area: observational study. BMJ 2005; 330: 995-.
- KD Cowgill, M Ndiritu, J Nyiro, MP Slack, S Chiphatsi, A Ismail, et al. Effectiveness of Haemophilus influenzae type b conjugate vaccine introduction into routine childhood immunization in Kenya. JAMA 2006; 296: 671-8.
- RW Snow, JR Schellenberg, D Forster, VO Mung’ala, K Marsh. Factors influencing admission to hospital during terminal childhood illnesses in Kenya. Int J Epidemiol 1994; 23: 1013-9.
- AJ Brent, I Ahmed, M Ndiritu, P Lewa, C Ngetsa, B Lowe, et al. Incidence of clinically significant bacteraemia in children who present to hospital in Kenya: community-based observational study. Lancet 2006; 367: 482-8.
- R Garg, W Omwomo, JM Witte, LA Lee, MS Deming. Care seeking during fatal childhood illnesses: Siaya District, Kenya, 1998. Am J Public Health 2001; 91: 1611-3.
- Murray CJL, Lopez ADE. The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Boston: Harvard School of Public Health; 1996.
- I Mwangi, J Berkley, B Lowe, N Peshu, K Marsh, CR Newton. Acute bacterial meningitis in children admitted to a rural Kenyan hospital: increasing antibiotic resistance and outcome. Pediatr Infect Dis J 2002; 21: 1042-8.
- 2004 vaccine projections: quantities and pricing. Available at: http://www.unicef.org/supply/files/UNICEF_-_procuring_supplies_for_children_-_GAVI.pdf
- T Adam, DB Evans, CJ Murray. Econometric estimation of country-specific hospital costs. Cost Eff Resour Alloc 2003; 1: 3-.
- Heyse JF, Cook JR, Carides GW. Statistical considerations in analysing health care resource utilization and cost data. In: Drummond M, McGuire A, editors. Economic evaluation in health care: merging theory with practice. Oxford: Oxford University Press; 2001.
- RA Adegbola, O Secka, G Lahai, N Lloyd-Evans, A Njie, S Usen, et al. Elimination of Haemophilus influenzae type b (Hib) disease from the Gambia after the introduction of routine immunisation with a Hib conjugate vaccine: a prospective study. Lancet 2005; 366: 144-50.
- Threshold values for intervention cost-effectiveness by region. Available at: www.who.int/choice/costs/CER_levels/en/indexhtml
- CA Goodman, PG Coleman, AJ Mills. Cost-effectiveness of malaria control in sub-Saharan Africa. Lancet 1999; 354: 378-85.
- CS Currie, K Floyd, BG Williams, C Dye. Cost, affordability and cost-effectiveness of strategies to control tuberculosis in countries with high HIV prevalence. BMC Public Health 2005; 5: 130-.
- WHO vaccine preventable diseases monitoring system. 2005 global summary. Geneva: WHO; 2005 (WHO/IVB/2005).
- E Molyneux, A Walsh, A Phiri, M Molyneux. Acute bacterial meningitis in children admitted to the Queen Elizabeth Central Hospital, Blantyre, Malawi, in 1996-97. Trop Med Int Health 1998; 3: 610-8.
- RW Snow, VO Mung’ala, D Foster, K Marsh. The role of the district hospital in child survival at the Kenyan Coast. Afr J Health Sci 1994; 1: 71-5.
- J Kohn, S Weiner. Pneumonia in children: a survey of one thousand cases with attempted follow-up. Am J Dis Child 1936; 51: 1095-100.
- Kenya Medical Research Institute (KEMRI)/Wellcome Trust, Nairobi, Kenya.
- KEMRI/Wellcome Trust, Kilifi, Kenya. Nuffield Department of Clinical Medicine, University of Oxford, England.
- London School of Hygiene and Tropical Medicine, Health Policy Unit, Keppel Street, London WC1B 3DP, UK.