Understanding and measuring quality of care: dealing with complexity
Johanna Hanefeld a, Timothy Powell-Jackson a & Dina Balabanova a
a. London School of Hygiene & Tropical Medicine, Keppel Street, London, WC1E 7HT, England.
Correspondence to Johanna Hanefeld (email: firstname.lastname@example.org)
(Submitted: 15 June 2016 – Revised version received: 13 January 2017 – Accepted: 30 January 2017 – Published online: 20 March 2017.)
Bulletin of the World Health Organization 2017;95:368-374. doi: http://dx.doi.org/10.2471/BLT.16.179309
Policies to improve population health have often focused exclusively on the expansion of access to basic health services, to the neglect of quality of care. Efforts to increase the demand for priority interventions have implicitly assumed that the care available is of sufficient quality or that, with the expansion of coverage, quality will naturally improve.1 However, such assumptions may be incorrect. There is growing recognition that people may be acting in a perfectly rational way when they avoid using health services of poor quality and that poor quality of care can be a barrier to universal health coverage independent of access.2
The aim of many strategies to improve health-care quality has been to ensure that essential inputs – e.g. technology, operational facilities, pharmaceutical supplies and trained health workers – are in place.3 Many such strategies have focused on the supply side and been designed to support the provision of services according to clinical guidelines.4 The acknowledgement that quality improvement approaches should be applied within patient-centred models of care is relatively recent.5
In this paper we seek to unpack complexities around quality of care and identify strategies for improving the measurement of such quality. An understanding of these issues could inform pragmatic strategies for the analysis and measurement of quality of care. We draw on research conducted in a variety of low- and middle-income countries and identify areas of inherent complexity that require further in-depth research. In doing so, we reflect on what is meant by quality of care and how perceptions and understanding of quality of care influence health systems and effect the measurement of quality.
We have identified and structured our discussion around six conceptual and measurement challenges. First is the recognition that, even though they may not reflect actual quality, perceptions of the quality of care are an important driver of care utilization. Second, a patient’s experience of quality must be conceptualized as occurring over time. Third, responsiveness to the patient is a key attribute of quality. Fourth, so-called upstream factors – e.g. management at facility and higher levels – are likely to be important for quality. Fifth, quality can be considered as a social construct co-produced by different actors. Finally, there are substantial measurement challenges that require the adaptation and improvement of current approaches.
The classic framework on quality of care developed by Donabedian makes the distinction between structure, process and outcomes.6 More recently, the Institute of Medicine in the United States of America (USA) has unpacked the concept further and suggested that efforts to improve care quality should be focused around six aims: effectiveness, efficiency, equity, patient-centredness, safety and timeliness. We do not seek to propose a new framework for understanding quality. Rather, we highlight some key issues that deserve more consideration in debates about enhancing the accessibility and quality of care. Building on our experiences of doing empirical research in low- and middle-income countries, we present several insights that are complementary to existing, comprehensive frameworks of quality of care and may be absent from current debates.
Clinical quality of care relates to the interaction between health-care providers and patients and the ways in which inputs from the health system are transformed into health outcomes. The care provided should be effective, evidence-based and neither underused nor overused.7 The concept of clinical effectiveness tends to shift attention away from inputs such as drugs and equipment and towards the process of care.6,8 While relatively easy to measure, the availability of inputs cannot generally be used in isolation to determine if a patient’s health is likely to improve as a result of the care received.9 Clinical processes are directly attributable to the behaviour of health-care providers and their measurement can provide a critical starting point in the development of methods to improve care received by patients. Although health outcomes can be informative, they are only likely to be a crude measure of quality because of the inherent unpredictability in patients’ responses to health care.9
Assessment of the clinical quality of care poses several conceptual and practical challenges. It requires a strong evidence base that can act as a benchmark against which to evaluate interventions. In high-income countries, treatments received can be compared with the treatments recommended in national guidelines. In many low- and middle-income countries, however, such guidelines are either not available or poorly enforced. Even when such guidelines are present, the evaluation of what constitutes the overprovision of care is not clear-cut and requires careful judgement. Although harmful care should be distinguished from unnecessary care, such categorization can be difficult in practice. Care for a single patient may be provided over the course of numerous interactions by a large team of health professionals. In such circumstances, measurement of the quality of care often focuses on a small number of distinct interventions with proven efficacy.
There are several well-known practical challenges to the assessment of the clinical quality of care. For example, it may not be possible to observe the interactions between patients and their physicians and, when they are possible, such observations can generate bias through the Hawthorne effect, i.e. health-care providers change their behaviour when observed.10 In low- and middle-income countries, medical records are often poorly maintained and may not reflect actual practice. The use of so-called undercover or standardized patients in the assessment of clinical care may raise ethical concerns,11 is generally limited to non-invasive conditions12 and is not a practical solution to the routine measurement of quality.9 Despite these challenges, an influential literature on the clinical quality of care in low- and middle-income countries is emerging.2,13
Attempts to improve the quality of care have often been underpinned by a biomedical understanding of quality – i.e. the conceptualization of a gold standard of quality guided by clinical guidelines – that can lead to a narrow focus. Provider practices tend to vary despite the existence of accountability procedures and guidelines.14 Interventions may not be implemented as intended or easily accommodated within established models of care.15 Clinical quality is important for patient outcomes but perceptions of the quality of care – which may not correlate with actual quality – are likely to be the key drivers of utilization.16,17 Patients may also find it difficult to evaluate the quality of care because they lack their physician’s medical expertise and training.18,19
In South Africa, a key motivating factor in patients’ travel to access health services – including travel across borders – was found to be the patients’ perceptions of the quality of health services.20 Patients may sometimes believe an ineffective and unsafe treatment to be good, even when they have access to effective and safe treatments. In Malaysia, for example, many people with hypertension seek potentially ineffective and unsafe treatments from traditional practitioners.21 Perceptions of the quality of care are based on a mix of individual experience, processed information and rumour. In Uganda, perceptions of the quality of the care that was locally available were found to have persuaded many women to seek maternal care away from their local area – apparently regardless of the availability of transportation and the distances involved.22 In Bangladesh, despite a nationwide expansion in the network of health facilities, facility-based deliveries remained rare and most women still attempted to give birth at home or, in the case of complications, at distant periurban health centres that the women believed to offer care of higher quality than that available at the community facilities closest to their homes.23,24 Patients’ trust in services has been shown to be an important element of perceived quality.25
Perceptions of the quality of care may relate entirely to non-clinical factors. For example, criminalized or marginalized populations – e.g. some ethnic or sexual minorities – may judge the quality of care only according to the extent that the care environment is non-discriminatory or supportive.26 In Zambia, many patients considered public-sector clinics supported by one particular nongovernmental organization to be better than other public-sector facilities that apparently provided the same standardized package of care.27
The effect of perceived quality is not limited to delivery models. Among remote rural populations in Armenia, there was disappointingly low participation in community-based health-insurance schemes because the quality of the care provided by the schemes was perceived to be low. Despite the often high out-of-pocket costs, most people in the communities covered by the schemes preferred to use district-based clinics and hospitals – where they believed the quality of care to be higher than in the facilities covered by the schemes.28 Although quality is a construct largely based on individual subjective perceptions, such perceptions are shaped by collective and traditional beliefs and peer influences. While improving or, at least, maintaining the actual quality of the care they provide, health systems need to address – and ultimately close – the gap between perceived and actual quality.
Quality as a process
There is a temporal dimension to both clinical and perceived quality. Although the Donabedian framework recognizes the importance of understanding the process of care,6,8 the quality of care may often be assessed in just a single encounter or illness episode. However, individual treatment for most diseases is not a one-off event but a succession of treatment episodes. Patients’ perceptions of quality may develop over time, as the different attributes of the services available and their outcomes are revealed. Waiting times and staff attitudes may be perceived rapidly. However the patient’s experience of clinical treatment, e.g. surgery, and its implications for subsequent care, e.g. frequent check-ups, and health outcomes, e.g. potential complications, may carry on developing over months or years. Patients may only become sensitized to the benefits of having a dedicated provider and effective follow-up after they experience the absence of such benefits. Easy-to-navigate pathways to care and continuity are critical to how patients perceive the quality of care and choose whether to continue treatment or not.29 Long-term compliance is only likely if the patients involved consider their care to be of good quality. Such compliance is a particular challenge in the monitoring and treatment of chronic noncommunicable diseases and human immunodeficiency virus, especially for the under-resourced health systems of low- and middle-income countries.30–33
While The World health report 2000. Health systems: improving performance34 defined responsiveness to people’s non-medical expectations as a key health-systems goal, the relationship between responsiveness and quality has rarely been discussed. Although ability to book an appointment, confidentiality, privacy, respect shown by staff and waiting times are not service attributes that are clinically necessary, they may all influence patients’ perceptions and their willingness to return for – or adhere to – treatment. At a broader level, responsiveness involves respect for cultural needs and the preferences of specific patient groups – e.g. ethnic, gender and sexual minorities and migrants. The relationship between health workers and their patients often develops over time and multiple episodes of care. As levels of trust and mutual understanding increase, responsiveness and the patients’ perceptions of the quality of their care often improve.35
Although responsiveness to need is often consistent with good clinical practice, it represents an added layer in the patients’ perceptions of quality. In one South African study, women appeared to have been given greater access to public maternity wards but it was the verbal abuse that the women often suffered on such wards that largely shaped the women’s poor perceptions of the care that they had received.36
The patient–provider interaction is likely to be influenced by governance and management practices at national, subnational and facility levels. The results of studies in the United Kingdom of Great Britain and Northern Ireland and the USA have demonstrated the key importance of management in ensuring care of high quality.37 In low- and middle-income countries, however, there appears to have been little consideration of the role of management practices – especially at district or facility level – in influencing the quality of care. There is increasing recognition that health professionals do not act in isolation and that governance, management and structural factors also determine the performance of health systems.38,39
Even when frontline providers do have substantial discretion in their interpretation of regulations and freedom to adapt treatment protocols, their actions may still largely depend on upstream factors related to institutional capacity, legal sanctions and professional norms. A study of tuberculosis cases in Samara, in the Russian Federation, revealed that while entry to the care system was relatively easy and formally free and pharmaceuticals were highly subsidized, some cases from marginalized groups – e.g. former prisoners, migrants and people not registered with the authorities – still avoided treatment because of perceived discrimination, loss of social status and stigma.40 Both behavioural and structural factors can be important when assessing perceived quality of care.
Quality as a social construct
Assessment of quality of care in low- and middle-income countries is frequently conducted at the individual level by using various tools – e.g. clinical observations, exit and in-depth interviews, extraction of medical records, role-playing vignettes and standardized patients, designed to assess both patients’ experiences and technical quality. However, social networks influence perceptions relating to both health services and illness.41 Therefore, for a comprehensive investigation of the development of the general public’s and patients’ perceptions of the quality of care, we need to examine community and family values.
In many situations, patients may have responses to a health provider’s actions and, similarly, providers may adapt their responses to patients to suit social norms.42 For example, a patient may be recommended a clinical investigation and they may either agree to be investigated – e.g. if the proposed investigation is offered by a provider trusted by the patient’s social network – or they may exit the system and seek care elsewhere, e.g. from a more trusted traditional practitioner. Such responses may be considered as a social relationship that can happen in formal care settings, or elsewhere.
Perception of quality can also be shaped by power relationships in society. In a study in the Russian Federation, the women most likely to undergo pregnancy-related procedures were found to be the relatively young and poorly educated. Although such women were relatively poor and therefore found it particularly hard to pay for their care, they appeared to be given little choice – possibly because of their relatively low social status and inability to negotiate care that was commensurate to their needs.43 Similar discrepancies between what health professionals felt would improve the quality of care for non-compliant patients and those patients’ preferences and wishes were observed in a study of tuberculosis cases in India. In that study, the number of treatment choices offered was found to be positively correlated with social status.44
In light of the above discussion, there is a case for taking a broader perspective when measuring quality of care. Although this has been recognized by the World Health Organization’s monitoring framework for universal health coverage45 – which considers effectiveness of treatment, patient safety, people-centredness and the level of integration of health services as key dimensions – the focus of recent assessments of the quality of care has been on indicators of health-service coverage.45,46
We suggest that, for a comprehensive and detailed assessment of the quality of health services, both clinical and perceived quality of care need to be evaluated and then compared (Box 1). Alongside technical measures of quality, attention should be given to manifestations of quality – e.g. acceptability, cultural appropriateness and responsiveness. Strategies to improve clinical quality only have the potential to increase demand for care if the general public’s perceptions of the quality of the care available also improve.
Box 1. Principles for measuring the quality of health care
- Measure aspects of care that go beyond technical quality, e.g. responsiveness, acceptability and trust.
- Measure perceived quality and compare with clinical quality.
- Measure quality at different points in the patient pathway through the health system.
- Measure the immediate and upstream drivers of quality of care.
- Measure collective and individually assessed quality and its relationship to power, social norms, trust and values.
Any evaluation of the overall quality of care needs to consider a patient’s experience of quality as a cumulative process. Changing patterns of illness and increasing numbers of treatment options mean that an increasing amount of health care involves a sequence of interlinked contacts – with a range of health professionals at different levels of the health system – over a lengthy period.47 A patient’s perceptions may vary widely as treatment follows diagnosis and follow-up follows treatment, with each stage potentially affecting the patient’s subsequent choices. By measuring clinical and perceived quality at each key step in this continuum of care, it should be possible to generate a better, more nuanced understanding of how patients interact with health systems.
A growing body of work focusing on measures of patients’ perceptions now exists. To understand these perceptions more holistically, qualitative methods need to become an integral part of quality assessments. In such assessments, theory-driven hierarchical models can be useful in generating propositions to guide empirical research or help deepen interpretation.48 Mid-range programme theories48 and open-box evaluations49 have also been useful in examining why and how particular health programmes work. Although the measurement of indicators that are rapidly observed by patients seeking care – e.g. staff attitudes and waiting times – can be useful, it is important to delve deeper and study how upstream factors, such as management practices, matter – e.g. by influencing staff morale. Use of carefully selected proxies for quality of care and comparison of findings generated through different methods may help to inform pragmatic intervention strategies.
Finally, assessment of individual perceptions of the quality of care and examination of how such perceptions are rooted in community, family and societal expectations, norms and values may offer a promising way forward. Perceived quality may correlate closely with the expectations and social status of the users themselves, the circumstances in which the users obtain care and/or the levels of community cohesion and resources that enable collective action. Although the inclusion of contextual variables and appropriate units of observation for studying community and social group-level characteristics may be methodologically challenging, it is important for understanding individual choices and perceptions.
Recognition of the multifaceted nature of the quality of care is critical for scaling up priority health interventions. If uptake of health services is to be increased, we require not only better technical quality but also better acceptability and patient-centredness – across the continuum of care. Perceptions of quality are shaped by interconnected community, health-system and individual factors. Moreover, quality of care cannot be understood fully without some appreciation of the social norms, relationships and values and trust within the communities and societies where care is provided.
- Ensor T, Cooper S. Overcoming barriers to health service access: influencing the demand side. Health Policy Plan. 2004 Mar;19(2):69–79. http://dx.doi.org/10.1093/heapol/czh009 pmid: 14982885
- Berendes S, Heywood P, Oliver S, Garner P. Quality of private and public ambulatory health care in low and middle income countries: systematic review of comparative studies. PLoS Med. 2011 Apr;8(4):e1000433. http://dx.doi.org/10.1371/journal.pmed.1000433 pmid: 21532746
- Bhutta ZA, Ahmed T, Black RE, Cousens S, Dewey K, Giugliani E, et al.; Maternal and Child Undernutrition Study Group. What works? Interventions for maternal and child undernutrition and survival. Lancet. 2008 Feb 2;371(9610):417–40. http://dx.doi.org/10.1016/S0140-6736(07)61693-6 pmid: 18206226
- Heiby J. The use of modern quality improvement approaches to strengthen African health systems: a 5-year agenda. Int J Qual Health Care. 2014 Apr;26(2):117–23. http://dx.doi.org/10.1093/intqhc/mzt093 pmid: 24481053
- WHO global strategy on people-centred and integrated health services. Geneva: World Health Organization; 2015. Available from: http://apps.who.int/iris/bitstream/10665/155002/1/WHO_HIS_SDS_2015.6_eng.pdf [cited 2016 Jun 10].
- Donabedian A. Explorations in quality assessment and monitoring. the definition of quality and approaches to its assessment. Chicago: Health Administration Press; 1980.
- Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington DC: National Academy Press; 2001.
- Donabedian A. The quality of care. How can it be assessed? JAMA. 1988 Sep 23-30;260(12):1743–8. http://dx.doi.org/10.1001/jama.1988.03410120089033 pmid: 3045356
- Peabody JW, Taguiwalo MM, Robalino DA, Frenk J. Improving the quality of care in developing countries. In: Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M, Evans DB, et al., editors. Disease control priorities in developing countries. 2nd ed. Washington DC: World Bank; 2006. pp. 1293–307.
- Leonard KL, Masatu MC. Using the Hawthorne effect to examine the gap between a doctor’s best possible practice and actual performance. J Dev Econ. 2010;93(2):226–34. http://dx.doi.org/10.1016/j.jdeveco.2009.11.001
- Rhodes KV, Miller FG. Simulated patient studies: an ethical analysis. Milbank Q. 2012 Dec;90(4):706–24. http://dx.doi.org/10.1111/j.1468-0009.2012.00680.x pmid: 23216428
- Das J, Holla A, Das V, Mohanan M, Tabak D, Chan B. In urban and rural India, a standardized patient study showed low levels of provider training and huge quality gaps. Health Aff (Millwood). 2012 Dec;31(12):2774–84. http://dx.doi.org/10.1377/hlthaff.2011.1356 pmid: 23213162
- Das J, Hammer J, Leonard K. The quality of medical advice in low-income countries. J Econ Perspect. 2008 Spring;22(2):93–114. http://dx.doi.org/10.1257/jep.22.2.93 pmid: 19768841
- Danishevski K, McKee M, Balabanova D. Variations in obstetric practice in Russia: a story of professional autonomy, isolation and limited evidence. Int J Health Plann Manage. 2009 Apr-Jun;24(2):161–71. http://dx.doi.org/10.1002/hpm.934 pmid: 18461631
- Marx FM, Atun RA, Jakubowiak W, McKee M, Coker RJ. Reform of tuberculosis control and DOTS within Russian public health systems: an ecological study. Eur J Public Health. 2007 Feb;17(1):98–103. http://dx.doi.org/10.1093/eurpub/ckl098 pmid: 16837521
- Chang JT, Hays RD, Shekelle PG, MacLean CH, Solomon DH, Reuben DB, et al. Patients’ global ratings of their health care are not associated with the technical quality of their care. Ann Intern Med. 2006 May 2;144(9):665–72. http://dx.doi.org/10.7326/0003-4819-144-9-200605020-00010 pmid: 16670136
- Das J, Sohnesen TP. Patient satisfaction, doctor effort and interview location: evidence from Paraguay. Policy Research Working Paper No. WPS 4086. Washington DC: World Bank; 2006.
- Arrow KJ. Uncertainty and the welfare economics of medical care. Am Econ Rev. 1963;53(5):941–73.
- Arrow KJ. Rationality of self and others in an economic system. J Bus. 1986;59 S4:S385–99. http://dx.doi.org/10.1086/296376
- Walls HL, Vearey J, Modisenyane M, Chetty-Makkan CM, Charalambous S, Smith RD, et al. Understanding healthcare and population mobility in southern Africa: The case of South Africa. S Afr Med J. 2015 11 24;106(1):14–5. http://dx.doi.org/10.7196/SAMJ.2016.v106i1.10210 pmid: 26792300
- Risso-Gill I, Balabanova D, Majid F, Ng KK, Yusoff K, Mustapha F, et al. Understanding the modifiable health systems barriers to hypertension management in Malaysia: a multi-method health systems appraisal approach. BMC Health Serv Res. 2015 07 3;15(1):254. http://dx.doi.org/10.1186/s12913-015-0916-y pmid: 26135302
- Parkhurst JO, Ssengooba F. Assessing access barriers to maternal health care: measuring bypassing to identify health centre needs in rural Uganda. Health Policy Plan. 2009 Sep;24(5):377–84. http://dx.doi.org/10.1093/heapol/czp023 pmid: 19520736
- Balabanova DMM, Mills A. Good health at low cost’ 25 years on. What makes a successful health system? London: London School of Hygiene & Tropical Medicine; 2011.
- Normand C, Iftekhar MHM, Rahman SA. Assessment of the community clinics: effects on service delivery, quality and utilisation of services. Dhaka: Ministry of Health and Family Welfare; 2002.
- Gilson L. What sort of stewardship and health system management is needed to tackle health inequity, and how can it be developed and sustained? Johannesburg: Centre for Health Policy; 2007.
- Beyrer C, Sullivan PS, Sanchez J, Dowdy D, Altman D, Trapence G, et al. A call to action for comprehensive HIV services for men who have sex with men. Lancet. 2012 Jul 28;380(9839):424–38. http://dx.doi.org/10.1016/S0140-6736(12)61022-8 pmid: 22819663
- Hanefeld J, Musheke M. What impact do Global Health Initiatives have on human resources for antiretroviral treatment roll-out? A qualitative policy analysis of implementation processes in Zambia. Hum Resour Health. 2009 02 10;7(1):8. http://dx.doi.org/10.1186/1478-4491-7-8 pmid: 19208253
- Poletti T, Balabanova D, Ghazaryan O, Kocharyan H, Hakobyan M, Arakelyan K, et al. The desirability and feasibility of scaling up community health insurance in low-income settings–lessons from Armenia. Soc Sci Med. 2007 Feb;64(3):509–20. http://dx.doi.org/10.1016/j.socscimed.2006.09.005 pmid: 17097789
- Balabanova D, McKee M, Koroleva N, Chikovani I, Goguadze K, Kobaladze T, et al. Navigating the health system: diabetes care in Georgia. Health Policy Plan. 2009 Jan;24(1):46–54. http://dx.doi.org/10.1093/heapol/czn041 pmid: 19074492
- Mwangome MN, Geubbels E, Klatser P, Dieleman M. “I don’t have options but to persevere.” Experiences and practices of care for HIV and diabetes in rural Tanzania: a qualitative study of patients and family caregivers. Int J Equity Health. 2016 04 2;15:56. http://dx.doi.org/10.1186/s12939-016-0345-5 pmid: 27038911
- Tassie J-M, Baijal P, Vitoria MA, Alisalad A, Crowley SP, Souteyrand Y. Trends in retention on antiretroviral therapy in national programs in low-income and middle-income countries. J Acquir Immune Defic Syndr. 2010 Aug;54(4):437–41. http://dx.doi.org/10.1097/QAI.0b013e3181d73e1b pmid: 20351559
- Boyles TH, Wilkinson LS, Leisegang R, Maartens G. Factors influencing retention in care after starting antiretroviral therapy in a rural South African programme. PLoS One. 2011 05 3;6(5):e19201. http://dx.doi.org/10.1371/journal.pone.0019201 pmid: 21559280
- Decroo T, Rasschaert F, Telfer B, Remartinez D, Laga M, Ford N. Community-based antiretroviral therapy programs can overcome barriers to retention of patients and decongest health services in sub-Saharan Africa: a systematic review. Int Health. 2013 Sep;5(3):169–79. http://dx.doi.org/10.1093/inthealth/iht016 pmid: 24030268
- The world health report 2000. Health systems: improving performance. Geneva: World Health Organization; 2000.
- Legido-Quigley H, Camacho Lopez PA, Balabanova D, Perel P, Lopez-Jaramillo P, Nieuwlaat R, et al. Patients’ knowledge, attitudes, behaviour and health care experiences on the prevention, detection, management and control of hypertension in Colombia: a qualitative study. PLoS One. 2015 04 24;10(4):e0122112. http://dx.doi.org/10.1371/journal.pone.0122112 pmid: 25909595
- Freedman LP, Kruk ME. Disrespect and abuse of women in childbirth: challenging the global quality and accountability agendas. Lancet. 2014 Sep 20;384(9948):e42–4. http://dx.doi.org/10.1016/S0140-6736(14)60859-X pmid: 24965825
- Tsai TC, Jha AK, Gawande AA, Huckman RS, Bloom N, Sadun R. Hospital board and management practices are strongly related to hospital performance on clinical quality metrics. Health Aff (Millwood). 2015 Aug;34(8):1304–11. http://dx.doi.org/10.1377/hlthaff.2014.1282 pmid: 26240243
- Topp SM, Chipukuma JM, Hanefeld J. Understanding the dynamic interactions driving Zambian health centre performance: a case-based health systems analysis. Health Policy Plan. 2015 May;30(4):485–99. http://dx.doi.org/10.1093/heapol/czu029 pmid: 24829316
- Balabanova D, Mills A, Conteh L, Akkazieva B, Banteyerga H, Dash U, et al. Good Health at Low Cost 25 years on: lessons for the future of health systems strengthening. Lancet. 2013 Jun 15;381(9883):2118–33. http://dx.doi.org/10.1016/S0140-6736(12)62000-5 pmid: 23574803
- Dimitrova B, Balabanova D, Atun R, Drobniewski F, Levicheva V, Coker R. Health service providers’ perceptions of barriers to tuberculosis care in Russia. Health Policy Plan. 2006 Jul;21(4):265–74. http://dx.doi.org/10.1093/heapol/czl014 pmid: 16728512
- Latkin CA, Davey-Rothwell MA, Knowlton AR, Alexander KA, Williams CT, Boodram B. Social network approaches to recruitment, HIV prevention, medical care, and medication adherence. J Acquir Immune Defic Syndr. 2013 Jun 1;63 Suppl 1:S54–8. http://dx.doi.org/10.1097/QAI.0b013e3182928e2a pmid: 23673888
- Ssengooba F, Rahman SA, Hongoro C, Rutebemberwa E, Mustafa A, Kielmann T, et al. Health sector reforms and human resources for health in Uganda and Bangladesh: mechanisms of effect. Hum Resour Health. 2007 02 1;5(1):3. http://dx.doi.org/10.1186/1478-4491-5-3 pmid: 17270042
- Danishevski K, Balabanova D, McKee M, Parkhurst J. Delivering babies in a time of transition in Tula, Russia. Health Policy Plan. 2006 May;21(3):195–205. http://dx.doi.org/10.1093/heapol/czl001 pmid: 16492726
- Fochsen G, Deshpande K, Ringsberg KC, Thorson A. Conflicting accountabilities: Doctor’s dilemma in TB control in rural India. Health Policy. 2009 Feb;89(2):160–7. http://dx.doi.org/10.1016/j.healthpol.2008.05.013 pmid: 18599148
- Tracking universal health coverage: first global monitoring report. Geneva: World Health Organization; 2015.
- Parkhurst JO, Danischevski K, Balabanova D. International maternal health indicators and middle-income countries: Russia. BMJ. 2005 Sep 3;331(7515):510–3. http://dx.doi.org/10.1136/bmj.331.7515.510 pmid: 16141161
- Innovative care for chronic conditions: building blocks for action: global report. Geneva: World Health Organization; 2002.
- Marchal B, Dedzo M, Kegels G. A realist evaluation of the management of a well-performing regional hospital in Ghana. BMC Health Serv Res. 2010 01 25;10(1):24. http://dx.doi.org/10.1186/1472-6963-10-24 pmid: 20100330
- Ssengooba F, McPake B, Palmer N. Why performance-based contracting failed in Uganda–an “open-box” evaluation of a complex health system intervention. Soc Sci Med. 2012 Jul;75(2):377–83. http://dx.doi.org/10.1016/j.socscimed.2012.02.050 pmid: 22560799