Comparing road traffic mortality rates from police-reported data and death registration data in China
Guoqing Hu a, Timothy Baker b & Susan P Baker b
a. School of Public Health, Central South University, 110 Xiangya Road, Changsha, 410078, China.
b. Johns Hopkins Bloomberg School of Public Health, Baltimore, United States of America.
Correspondence to Guoqing Hu (e-mail: firstname.lastname@example.org).
(Submitted: 07 June 2010 – Revised version received: 27 August 2010 – Accepted: 03 September 2010 – Published online: 07 September 2010.)
Bulletin of the World Health Organization 2011;89:41-45. doi: 10.2471/BLT.10.080317
Mortality from road traffic collisions is a serious public health problem in China. According to a review by Wang et al., deaths from vehicle collisions increased 97-fold between 1951 and 1999, and road traffic injuries have become the leading cause of death among persons 45 years of age and younger.1 To counteract the increasing threat to life from road traffic collisions, during the late 1990s and early 2000s China revised its road traffic laws and adopted many preventive measures that had proved effective in high-income countries. Notably, the road traffic death rate in China began to fall after 2002, as documented in the Global status report on road safety2 issued by the World Health Organization (WHO) in 2009. However, whether this recent decrease represents a genuine decline is questionable because: (i) China’s reported road traffic fatality rate in 2006 was extremely low compared with the rate observed in low- and middle-income countries (6.8 per 100 000 population in China versus 21.5 and 19.5, respectively);2 and (ii) the number of motor vehicles in China has increased rapidly in recent years.3
China, which is the country with the largest population in the world, accounts for about 13.5% of all deaths due to road traffic collisions.2 Thus, the quality of China’s road traffic injury data is critically important not only in terms of China’s ability to develop effective measures for preventing and controlling traffic injuries, but also in terms of priority-setting in health at the global level. Since the recent decrease in road traffic mortality rates in China is based on data from police reports, which are believed to underreport true rates of death from road traffic injuries in many countries,4–12 China must resort to other sources of data to determine whether death rates have indeed decreased. Such verification would lead to a better understanding of the true magnitude of the problem of fatal road traffic injuries in China.
In addition to police-reported data, China has death registration data that are collected by the Ministry of Health and that can also be used to estimate the rate of deaths from road traffic injuries. The ministry uses death registration data to estimate cause-specific death rates from various causes and has published these estimates in the China health statistics yearbook since 2002. Unfortunately, the Chinese government has rarely used death registration data to estimate mortality from road traffic injuries. Instead, it has relied on police reports because road safety falls under the jurisdiction of the Road Traffic Bureau of the Ministry of Public Security, which is responsible for collecting the data reported by the police. Although police-reported data have allegedly underestimated the actual rates of death from road traffic injuries in China,13 no one has yet compared police-reported data with death registration data to check for consistency between them.
This study rests on two working hypotheses: (i) that there is a substantial gap between road traffic death rates obtained from police reports and those derived from death registration data for the same time period; and (ii) that recent trends in mortality from road traffic injuries in China will differ depending on whether they are derived from death registration data or from police-reported data. Thus, the primary objective of the present study was to test these two hypotheses by checking for consistency between police-reported data and death registration data with respect to death rates from road traffic injuries in 2002–2007.
Police-reported data are extracted from police records on a standardized, closed-ended data collection form. The national Road Traffic Bureau is responsible for the design of the forms and other means to collect and register such data in China, and for releasing it four times a year and annually. All individuals who die of injuries sustained in a road traffic collision within 7 days of the incident are recorded as road traffic fatalities.14 Police-reported data are published and accessible in the China statistical yearbook of communication and transportation.
The cause-of-death surveillance system, which covers approximately 10% of the total population of China, is the source from which the Ministry of Health obtains death registration data. The diagnosed causes of death come from physicians’ death certificates, which are submitted to the local police department by family members of the deceased and forwarded to the municipal, provincial and national health departments.15 Physicians classify deaths resulting from road traffic injuries in accordance with the International Classification of Diseases (ICD, 9th revision before 2002 and 10th revision thereafter). In death certificates, deaths from road traffic injuries are not limited to those that occur within a specified period after injury. Road traffic injury mortality rates based on death registration data are published and accessible in the China health statistics yearbook.
Using the χ2 test, we compared death rates from road traffic injuries based on police-reported data with those based on death registration data for the period from 2002 to 2007. We used linear regression to check for statistically significant trends in mortality rates over the study period, and we used the percent change in the death rate between 2002 and 2007 to measure the linear trend. To calculate this trend we used b (the regression coefficient) divided by the death rate for 2002.16 The level of statistical significance was set at P < 0.05.
Fig. 1 shows that between 2002 and 2007, the road traffic death rate based on death registration data was almost twice as high as the rate reported by the police (P < 0.05) and almost as high as the rates found in low- and middle-income countries. We found no decline in road traffic mortality after 2005. In 2007, road traffic deaths numbered 81 649 according to police data and 221 135 according to death registration data. When we compared the death rates obtained from the two sources, we found that for every year from 2002 to 2006 the police-reported rate of death from road traffic injuries was consistently no more than 62% of the rate obtained from death registration data and, in fact, in 2007 the death rate based on police reports was only 37% of the rate based on death registration data.
Fig. 1. Comparison of road-traffic death rates based on police reports and on death registration data, China 2002–2007
Police-reported data and death registration data showed different trends in road traffic death rates. Linear regression showed a significant decline of 27% according to police-reported data during 2002–2007, as opposed to a non-significant increase of 8% according to death registration data.
Our findings support the hypotheses that rates of death from road traffic collisions based on police reports and on death registration data are different, and that unlike police-reported data, death registration data fail to show any recent decline. These inconsistencies strongly suggest that the decreasing trend in road traffic mortality shown by police-reported data may not be genuine. Such a decline was expected to occur as a result of the many interventions implemented by the Chinese Government in the prior decade to prevent road traffic collisions. China has revised road traffic safety laws, set lower speed limits, standardized road signs and signals, imposed stricter training and testing for driver licensing and instituted other preventive measures that have proved successful in developed countries.17
The inconsistencies described in this paper may reflect to some extent the use of different definitions of what constitutes a road traffic death. To date China’s Road Traffic Bureau has not specified whether or not it uses the same definition provided in the ICD, although their data, based on police reports, are more frequently cited than any other by researchers and international organizations such as WHO. On the other hand, the inconsistencies we have found suggest an underreporting of road traffic-related deaths in police records. In many countries, fewer traffic-related deaths and injuries are reported by the police than by other sources. In addition to differences in definitions, this may reflect differences in data collection methods. For example, in western Scotland, 45% of hospital admissions due to road traffic injuries were not recorded by the police.5 Loo et al. have reported that in the Hong Kong Special Administrative Region, China, the police-reported road collision rate was only 58–60% of the actual rate, and that underreporting was particularly high for children (reporting rate of 34%) and cyclists (reporting rate of 33%).7 In another study, some road traffic injuries were not reported to the police mainly because, according to respondents, it was “not necessary” or the incident was a “hit and run case”.6 Others have suggested that road traffic officials may be purposely underreporting casualty statistics to avoid criticism from superiors who expect to see rates go down.4 These and other possible reasons for the underreporting of road traffic deaths in China have been discussed elsewhere.3
Knowing the actual number of road traffic fatalities is essential for planning realistic policies aimed at reducing these deaths. The inconsistency between police-reported data and death registration data strongly suggests that: (i) the Government of China and international organizations should exercise caution in any decision-making stemming from the purported recent decrease in the road traffic death rate based on police reports; and (ii) the Government of China needs to improve the quality of the data. First, it should adopt the definition of “road traffic death” in the ICD. Second, it should integrate multiple data sources when estimating the burden of road traffic injuries and deaths because multiple data sources provide a more complete picture than a single source.18 Third, China could use the capture–recapture method to monitor the quality of existing data sources and estimate deaths from road traffic injuries. The capture–recapture approach has proved useful for evaluating the completeness of data sources and identifying biases within data sets.19,20 These strategies should also be considered by other countries, especially low- and middle-income countries where the lack of reliable data poses a serious problem.21
In conclusion, the inconsistencies between the rate of death from road traffic injuries based on police-reported data and on death registration data strongly suggest that the actual rate has not decreased in recent years. China needs to investigate the quality of police-reported data and of death registration data and to adopt measures for improving it. Active efforts to audit and monitor data quality, even if only in periodic or sample surveys, are clearly necessary.
This study was supported by the 2009 New Century Scholar Support Program of the Ministry of Education of China (NCET-10–0782) and by the Center for Injury Research and Prevention, Centers for Disease Control and Prevention (Grant CCR302486).
- Wang SY, Chi GB, Jing CX, Dong XM, Wu CP, Li LP. Trends in road traffic crashes and associated injury and fatality in the People’s Republic of China, 1951–1999. Inj Control Saf Promot 2003; 10: 83-7 doi: 10.1076/icsp.10.1.83.14105 pmid: 12772490.
- World Health Organization. Global status report on road safety: time for action. Geneva: World Health Organization; 2009. Available from: www.who.int/violence_injury_prevention/road_safety_status/2009 [accessed 1 August 2009].
- Hu G, Wen M, Baker TD, Baker SP. Road-traffic deaths in China, 1985–2005: threat and opportunity. Inj Prev 2008; 14: 149-53 doi: 10.1136/ip.2007.016469 pmid: 18523105.
- McDonald G, Davie G, Langley J. Validity of police-reported information on injury severity for those hospitalized from motor vehicle traffic crashes. Traffic Inj Prev 2009; 10: 184-90 doi: 10.1080/15389580802593699 pmid: 19333832.
- Jeffrey S, Stone DH, Blamey A, Clark D, Cooper C, Dickson K, et al., et al. An evaluation of police reporting of road casualties. Inj Prev 2009; 15: 13-8 doi: 10.1136/ip.2008.018630 pmid: 19190270.
- Dandona R, Kumar GA, Ameer MA, Reddy GB, Dandona L. Under-reporting of road traffic injuries to the police: results from two data sources in urban India. Inj Prev 2008; 14: 360-5 doi: 10.1136/ip.2008.019638 pmid: 19074240.
- Loo BP, Tsui KL. Factors affecting the likelihood of reporting road crashes resulting in medical treatment to the police. Inj Prev 2007; 13: 186-9 doi: 10.1136/ip.2006.013458 pmid: 17567975.
- Van HT, Singhasivanon P, Kaewkungwal J, Suriyawongpaisal P, Khai LH. Estimation of non-fatal road traffic injuries in Thai Nguyen, Vietnam using capture-recapture method. Southeast Asian J Trop Med Public Health 2006; 37: 405-11 pmid: 17125007.
- Amoros E, Martin JL, Laumon B. Under-reporting of road crash casualties in France. Accid Anal Prev 2006; 38: 627-35 doi: 10.1016/j.aap.2005.11.006 pmid: 16545764.
- Dandona R, Mishra A. Deaths due to road traffic crashed in Hyderabad city in India: need for strengthening surveillance. Natl Med J India 2004; 17: 74-9 pmid: 15141599.
- Cercarelli LR, Rosman DL, Ryan GA. Comparison of accident and emergency with police road injury data. J Trauma 1996; 40: 805-9 doi: 10.1097/00005373-199605000-00021 pmid: 8614084.
- Rosman DL, Knuiman MW. A comparison of hospital and police road injury data. Accid Anal Prev 1994; 26: 215-22 doi: 10.1016/0001-4575(94)90091-4 pmid: 8198690.
- Fei X, Hu J, Liu X. Research on problems about statistical index system of traffic accidents in China. Highway 2006; 7: 133-5.
- Zhang J, Norton R, Tang KC, Lo SK, Jiatong Z, Wenkui G. Motorcycle ownership and injury in China. Inj Control Saf Promot 2004; 11: 159-63 doi: 10.1080/156609704/233/289643 pmid: 15764102.
- Wang Y, Li L. Assessment of completeness of Chinese vital registration data. Chin J Health Stat 2007; 24: 367-71.
- Hu G, Wilcox HC, Wissow L, Baker SP. Mid-life suicide: an increasing problem in U.S. Whites, 1999–2005. Am J Prev Med 2008; 35: 589-93 doi: 10.1016/j.amepre.2008.07.005 pmid: 19000847.
- Zhenglin F. Speech delivered by the Vice Minister of Public Security of the People’s Republic of China at a ministerial conference on road-traffic safety held in Beijing, China, in April 2006. Available from: http://www.moc.gov.cn/2006/06jiaotongaq/anquandt/gongluaq/200702/t20070216_184082.html [accessed 5 December 2009]. Chinese.
- Lyons RA, Ward H, Brunt H, Macey S, Thoreau R, Bodger OG, et al., et al. Using multiple datasets to understand trends in serious road traffic casualties. Accid Anal Prev 2008; 40: 1406-10 doi: 10.1016/j.aap.2008.03.011 pmid: 18606273.
- Meuleners LB, Lee AH, Cercarelli LR, Legge M. Estimating crashes involving heavy vehicles in Western Australia, 1999–2000: a capture-recapture method. Accid Anal Prev 2006; 38: 170-4 doi: 10.1016/j.aap.2005.09.003 pmid: 16221468.
- Razzak JA, Luby SP. Estimating deaths and injuries due to road traffic accidents in Karachi, Pakistan, through the capture-recapture method. Int J Epidemiol 1998; 27: 866-70 doi: 10.1093/ije/27.5.866 pmid: 9839745.
- Bener A, Abu-Zidan FM, Bensiali AK, Al-Mulla AA, Jadaan KS. Strategy to improve road safety in developing countries. Saudi Med J 2003; 24: 603-8 pmid: 12847587.