Bulletin of the World Health Organization

Economic evaluation of hepatitis B vaccination in low-income countries: using cost-effectiveness affordability curves

Sun-Young Kim a, Joshua A Salomon b, Sue J Goldie a

Introduction

Hepatitis B virus (HBV) infection remains a global public health challenge that causes significant morbidity and mortality,1 and the burden of disease is especially high in less-developed countries.2 Since 2000, the GAVI Alliance (formerly the Global Alliance for Vaccines and Immunisation) and the Vaccine Fund have accelerated the introduction of HBV vaccines in low-income countries by providing five years of funding for new and underused vaccines, including HBV vaccines.3 As of April 2005, mainly as a result of these efforts, 158 of 192 WHO Member States had adopted routine infant or childhood vaccination against HBV (GAVI Working Group, unpublished data, 2005). Moreover, building on the success of phase 1 of the programme (2000–2005), more resources were mobilized, and the GAVI Alliance decided to extend its support for the 72 poorest countries for phase 2 (2006–2015).4

However, there is no guarantee of long-term support for HBV vaccines, and each recipient country is required to cofinance its immunization programme, gradually increasing its contribution to a self-sustainable level at the end of the current grant.4 Therefore, despite the GAVI Alliance’s extended support, each recipient country needs to be conscious of the financial sustainability of its HBV vaccination programme and, accordingly, each country will need information on the total amount of resources required to fund the programme. The introduction of other new and underused vaccines – for example, those against Haemophilus influenzae type b (Hib) and yellow fever – in an increasing number of countries may intensify competition for limited resources. Finally, there will inevitably be uncertainty surrounding the real-world benefits of vaccination (for example, the ability to achieve adequate vaccine coverage) and the resources required to implement and sustain programmes,5 particularly in settings with weak health infrastructure, which will further complicate budget-related decisions.

In this context, decision-makers will likely benefit from additional information about whether an HBV vaccination programme is affordable and cost-effective. In addition, decision-makers will benefit from an explicit recognition that the information will be uncertain and from analyses that take into account this uncertainty. In part, this has been addressed by summarizing cost-effectiveness results using cost-effectiveness acceptability curves; these curves show the probability that a programme will be cost-effective as a function of different thresholds for acceptable cost–effectiveness ratios.6 However, one limitation of this approach is that the total amount of resources required to fund a programme is not considered.7 The cost-effectiveness affordability curve proposed by Sendi and Briggs overcomes this limitation because it presents the probabilities that a programme is simultaneously cost-effective and affordable as a function of both the threshold cost–effectiveness ratio and budgetary constraints.8 To illustrate the usefulness of providing decision-makers with information on affordability and cost-effectiveness while formally accounting for uncertainty, we applied this approach to a real-world policy example: the programme to vaccinate infants against HBV in the Gambia.

Methods

Analytical overview

Using the example, we first evaluated the programme’s cost-effectiveness and derived cost-effectiveness acceptability curves. The cost-effectiveness of a programme was benchmarked in reference to specified thresholds, such as per-capita gross domestic product (GDP). A cost-effectiveness acceptability curve, constructed in the context of a multivariate uncertainty analysis, presents the probability that a programme will be cost-effective in relation to a range of different cost-effectiveness thresholds.

We next assessed affordability at country level in terms of the annual expected cost for the vaccination programme compared with a specified programme budget. We considered a range of circumstances under which the programme might be assigned a single fixed budget. An affordability curve – also derived within a multivariate uncertainty analysis – presents the probability that a programme will be affordable under various programme budgets.

The cost-effectiveness analysis was conducted from both a societal perspective and a payer perspective; the affordability analysis was conducted from the payer’s perspective. The societal perspective was chosen so that the cost-effectiveness results would be comparable with other studies; the payer perspective was chosen in order to explicitly consider affordability, since the payer is likely to play an important part in making decisions about the budget.

Finally, we simultaneously considered both cost-effectiveness and affordability, combining these results graphically in cost-effectiveness affordability curves. These curves depict the probabilities that a programme will be both cost-effective and affordable under different annual budgets and at different threshold values of cost-effectiveness.

A policy example

The Gambia – which has a per capita income of around US$ 300 and high HBV endemicity – first introduced the HBV vaccine in 1990, depending heavily on external aid (Gambian government, unpublished data, 2001) and eventually began offering it routinely to all infants. Since 2003, the Gambia has been receiving support from the Vaccine Fund for HBV vaccines and two other new and underused vaccines, Hib and yellow fever (Gambian government, unpublished data, 2004); nonetheless, the Gambia faces potential financial challenges. Extending earlier work,9 we assessed the cost-effectiveness of the routine vaccination of infants against HBV compared with no vaccination, reflecting recent changes in cost and new data on long-term vaccine efficacy and the incidence of liver cancer. We followed published guidelines for conducting cost-effectiveness analyses.1012

We developed a computer-based model for a birth cohort of 56 000 Gambian infants born in 2002 and simulated the health and economic consequences associated with HBV infection. The model takes into account the mother’s HBV infection status, the risk of transmission to the infant and the consequences resulting from HBV infection over the course of the cohort’s lifetime. The model’s outcomes include lifetime costs, cases of new HBV infection, primary liver cancer, disease-specific deaths and disability-adjusted life years (DALYs). A technical appendix (available from the authors upon request) includes details of the model schematic and assumptions, the natural history model of HBV infection and data sources. Tables 1 and 2 present baseline values, ranges and imposed distributions of epidemiological parameters.

For the analysis from a societal perspective, we estimated the direct medical costs – including programme costs (vaccine, injection supplies, delivery) and averted costs of medical treatment – and direct non-medical costs (travel, parents’ time spent immunizing children, patients’ time). In our analysis from the payer’s perspective, only programme costs were included. We adjusted for inflation using the Gambian GDP deflators,13 and expressed costs in 2002 US dollars. Table 3 summarizes the assumptions on costs (further detail is given in the technical appendix). The primary outcome measure was cost-effectiveness, expressed as the incremental cost per DALY averted for vaccination compared with no intervention. For the base case, all outcomes were discounted at 3% per year based on WHO guidelines,10 although other rates were used in the sensitivity analyses.

To explore parameter uncertainty, we conducted univariate sensitivity analyses (reported in the technical appendix) and multivariate probabilistic sensitivity analysis. For the latter, we specified distributions around uncertain parameters (Tables 1, 2 and 3, and technical appendix) and performed 1000 Monte Carlo simulations for each perspective. Results of the probabilistic sensitivity analyses were used in the subsequent derivation of cost-effectiveness acceptability curves and affordability curves.

Assumptions for the affordability consideration

We intentionally made simplifying assumptions to demonstrate the application of our analytical framework in the most transparent manner possible. These include the assumption that coverage for traditional vaccines used in the Expanded Programme on Immunization (measles, diphtheria–tetanus–pertussis, oral polio vaccine and bacille Calmette–Guérin) is already high (> 90% as of 2002) in the Gambia, so that investment in new and underused vaccines (HBV, Hib and yellow fever) are justified (Gambian government, unpublished data, 2003). Also, each routine infant vaccination programme is indivisible – meaning vaccination cannot be administered to only a fraction of infants – based on arguments that this would be inequitable. If there were a deficit in the funding for the national immunization programme, less-expensive monovalent vaccines would be used; and based on previous analyses,14,15 the childhood vaccination programmes would be assigned priority in the following order: traditional vaccines plus tetanus toxoid, HBV vaccine, other new and underused vaccines.

Derivation of an affordability curve and cost-effectiveness affordability curves

We evaluated programme affordability based on the joint distribution of simulated incremental health gains and the costs of HBV vaccination from the payer’s perspective. If we plot the simulated outcomes on a cost-effectiveness plane (which has net costs on the vertical axis and net health outcomes on the horizontal), an affordability curve captures the proportion of points in this plane that fall below the horizontal lines corresponding to different budget levels.8 A set of cost-effectiveness affordability curves combines the information from a cost-effectiveness acceptability curve and an affordability curve to capture the proportion of points that fall below both the diagonal line representing a particular cost-effectiveness threshold and the horizontal line representing a particular budget level.8

Findings

Table 4 presents the incremental cost–effectiveness ratio of vaccinating infants against HBV compared with no vaccination from the payer’s perspective. The point estimate provides information on the cost-effectiveness of the HBV programme, allowing the programme’s value-for-money to be compared with various benchmarks. For example, the programme’s incremental cost–effectiveness ratio of US$ 47 per DALY averted is lower than the Gambia’s per-capita GDP (around US$ 300), a measure often used as a surrogate indicator of the cost-effectiveness threshold below which a programme would be considered highly cost-effective.16 However, the point estimate does not consider uncertainty around the programme’s costs and effects.

The cost-effectiveness acceptability curve in Fig. 1 incorporates such uncertainty and presents the probability that the HBV vaccination programme is cost-effective in relation to different threshold values for cost-per-DALY ratios. The curve was constructed by plotting the proportion of simulated outcomes on a cost-effectiveness plane that fall below the diagonal lines through the origin of which slopes represent various cost-effectiveness cut-off points. The curve shows that the programme would not be considered cost-effective at thresholds < US$ 25 per DALY averted but would always be considered cost-effective at thresholds > US$ 97 per DALY averted. The curve also indicates that if the programme’s payer is willing to pay US$ 47 per DALY averted, there is a 65% probability the programme will be cost-effective.

Fig. 1. Cost-effectiveness acceptability curve.
Fig. 1. Cost-effectiveness acceptability curve.

A cost-effectiveness acceptability curve provides an intuitive visual summary of uncertainty about cost-effectiveness, but it does not explicitly account for potential constraints on total resources.7,8 On the other hand, an affordability curve does account for this constraint in presenting the probability that the total costs of a programme fall below a specified budget level. In our policy example (Fig. 2), the probability that the HBV programme is affordable is 0% up to a budget of US$ 157 000 but increases as the budget increases, reaching 100% when the budget increases to US$ 207 000. Accordingly, US$ 157 000 can be considered the lower boundary and US$ 207 000 the upper boundary of the amount of resources required for the programme. The curve also indicates that if the programme budget were set at US$ 182 000 per year based on the estimated average programme costs (Table 4), the probability that the programme will be affordable is only 58% because of the uncertainty surrounding the programme’s costs.

Fig. 2. This affordability curve shows the probability that the HBV vaccination programme would be affordable under various programme budgets. The US$ 182 000 budget is the point estimate of the projected annual programme costs.
Fig. 2. This affordability curve shows the probability that the HBV vaccination programme would be affordable under various programme budgets. The US$ 182 000 budget is the point estimate of the projected annual programme costs.

Fig. 3 combines the information provided by the cost-effectiveness acceptability curve and the affordability curve and presents a set of cost-effectiveness affordability curves for the three different levels of programme budget examined in Fig. 2. In the graph, each curve represents the probability that the HBV programme is both cost-effective and affordable at each combination of a cost-effectiveness threshold (horizontal axis) and a programme budget (indicated by legends for each curve). The bottom curve indicates that under programme budgets < US$ 157 000 (the lower bound of the resources required), the probability that the programme is simultaneously cost-effective and affordable is 0% regardless of the levels of willingness-to-pay since the probability that the programme is affordable is 0% under such low budgets. The middle curve shows that under the US$ 182 000 budget (the average programme cost), the probability that the programme is both affordable and cost-effective would increase as the cost-effectiveness threshold increases, reaching a maximum of 68% at the threshold of US$ 97 per DALY averted (the minimum threshold above which the probability that the programme is cost-effective is 100%). Similarly, the upper curve shows that the corresponding probability under the US$ 207 000 budget (the upper bound of the resources required) would reach 100% at the same threshold of US$ 97 per DALY averted. The curve under “no budget constraint” is identical to the curve under the US$ 207 000 budget. This implies that setting a programme budget above the upper bound of the resources required for the programme (US$ 207 000) would not add any further health benefits. It is also noteworthy that the curve under “no budget constraint” is by definition identical to the cost-effectiveness acceptability curve shown in Fig. 1. From a different angle, with a cost-effectiveness threshold set at US$ 47 per DALY averted (the point estimate of the incremental cost–effectiveness ratio) the probabilities that the programme is simultaneously cost effective and affordable are 0% under an annual budget of US$ 157 000, 40% under a budget of US$ 182 000, and 65% under a budget of US$ 207 000.

Fig. 3. Cost-effectiveness affordability curves show the probabilities that HBV vaccination is both cost effective and affordable under different annual budgets at varying threshold cost-effectiveness values.
Fig. 3. Cost-effectiveness affordability curves show the probabilities that HBV vaccination is both cost effective and affordable under different annual budgets at varying threshold cost-effectiveness values.

Discussion

We found from the policy example that vaccinating infants against HBV reduces the burden of HBV-related diseases by > 80%, and it is a highly cost-effective health intervention in the Gambia (Table 4). Our findings also showed that the programme has the potential to be affordable even with a relatively low annual budget of US$ 160 000 (Fig. 2).

Our example illustrates how cost-effectiveness affordability curves can enhance the information provided by traditional analyses of cost-effectiveness. While cost-effectiveness acceptability curves provide a valuable heuristic for summarizing the distribution of expected health and economic consequences in the setting of multivariate uncertainty, they do not distinguish between joint distributions of costs and effects that share the same correlations between these two dimensions but differ in scale.7,8 Cost-effectiveness affordability curves provide one way to address this limitation. When all points in the joint distribution of costs and benefits are positive on both dimensions (as is likely with most childhood vaccines), the consideration of budget constraints in addition to cost-effectiveness thresholds in analyses of multivariate uncertainty enhances the information available to guide real-world decisions.

Limitations

There are several limitations to this analysis. First, our modelling of a single birth cohort for the example does not reflect the indirect effects of vaccination on the force of infection (the rate at which susceptible individuals become infected) over time, and estimated benefits may be higher. Second, because our analysis is intended to demonstrate the framework of how one may add the dimension of affordability to cost-effectiveness analyses, we focused on the affordability of the HBV programme. We did not evaluate the affordability of all competing interventions, so this example provides only qualitative insight into the potential impact of the affordability of the HBV programme. We cannot draw conclusions that depend on the affordability of other programmes delivering new and underused vaccines that are competing for resources. Finally, we could not take into account the potential impact of technological changes that may considerably affect the programme’s cost-effectiveness, such as the introduction of pre-filled auto-disable devices or multivalent vaccines.

Implications

Despite the favourable cost-effectiveness profile of HBV vaccination programmes, without adequate long-term funding when the GAVI Alliance’s support is terminated, low-income countries such as the Gambia may face difficult decisions over how to set priorities and allocate limited resources among different childhood vaccines, and in particular new vaccines. In this context, the importance of examining affordability as well as cost-effectiveness when considering introducing a new vaccine should be increasingly emphasized.17,18 Few studies have explicitly examined the affordability of new vaccines under such circumstances, and no specific guidelines for evaluating affordability have been suggested.

In this regard, our study provides guidance relevant to policy-making in two respects. First, in the face of uncertainties about both the health and economic consequences of a programme, as well as the availability and magnitude of resources needed to fund the programme, policy-makers can use affordability curves to discern the probability that a new programme will be affordable under a specified budget or can project the consequences of assigning different amounts of funding to the programme over a range of programme budgets. Although economic studies that compare a programme’s annual per-capita cost with annual per-capita government health expenditure or compare a programme’s estimated annual average cost with its annual budget are useful, the approach suggested here takes into account uncertainty in the estimates of costs and benefits.19 Second, the cost-effectiveness acceptability curves may serve as tools to communicate results of complex probabilistic cost-effectiveness analyses to policy-makers. When policy-makers need information on affordability in addition to the cost-effectiveness of a new vaccine, a single illustration that combines the cost-effectiveness and affordability profile of the vaccine may allow for easier interpretation.

The usefulness of cost-effectiveness affordability curves is limited when a resource allocation problem needs to be addressed generally because it focuses on a single new programme’s fixed budget. In our example, we assumed that before support from the GAVI Alliance ended, low-income countries would be likely to secure sufficient resources to fund the traditional vaccines and might want to set a separate budget for the increased use of new and underused vaccines. We also assumed that there may not be sufficient resources available to fund all of the relatively expensive new and underused vaccines, and that if so, HBV vaccines would be assigned priority, based on the cost-effectiveness profiles reported in studies.14,15 If this is not the case, fully evaluating the HBV vaccination programme’s affordability requires a more comprehensive approach that explicitly considers the affordability of other competing vaccination programmes under a shared budget. For example, for the case in which the budget constraint is the total portfolio cost, Sendi and colleagues propose calculating the probability that each portfolio would be affordable over a range of budget levels by iterating Monte Carlo simulations of all relevant interventions and then calculating the joint distribution of the total portfolio costs and effectiveness through summation of each programme’s cost and effectiveness.20 However, if HBV vaccines are to be used in multivalent presentations (for example, diphtheria–tetanus–pertussis with HBV vaccine, or diphtheria–tetanus–pertussis with Hib and HBV vaccine) then an optimal mix of antigens should be identified, taking into account the fact that the cost of a combined vaccine would not be the sum of the costs of each monovalent vaccine. Additional research is needed to solve resource allocation problems and it should consider all relevant programmes under a shared budget and incorporate complicated constraints.

Nevertheless, given that such research would require an enormous amount of effort in a real-world setting, and that HBV vaccines might reasonably satisfy the assumptions necessary for the existence of a fixed budget based on the vaccines’ favourable cost-effectiveness profiles, an approach that considers cost-effectiveness, affordability and uncertainty can serve as a practical tool to provide valuable information to decision-makers in low-income countries who might face severe budget constraints for their HBV programmes or programmes for other new and underused vaccines. ■


References

Affiliations

  • Program in Health Decision Science, Health Policy and Management Department, Harvard School of Public Health, 718 Huntington Avenue, Boston, MA 02115, USA.
  • Population and International Health Department, Harvard School of Public Health, Boston, MA, USA.
Share