To: Lane3 who wrote (17230 ) 4/22/2010 5:06:12 PM From: Lane3 1 Recommendation Respond to of 42652 We're No. 37? Maybe Not ... By MERRILL GOOZNER Goozner Phil Musgrove, now at Health Affairs, was an editor at the World Health Organization when it compiled its international comparison of nations' health status that ranked the U.S. 37th in the world, largely because of its poor performance on infant mortality and longevity. In a letter to the editor in today's New England Journal of Medicine, he points out that the U.S. had no statistics for nearly half the measurements used in the rankings and that most of the national rankings were inputed from data from 30 of 191 countries in the survey who fully reported their health outcomes. He concludes: The number 37 is meaningless . . . Analyzing the failings of health systems can be valuable; making up rankings among them is not. It is long past time for this zombie number to disappear from circulation. Fair enough. But the U.S. ranking in infant mortality and its lagging longevity are cause for alarm because they show that the U.S. lags in health status. There's many factors well beyond the quality of the health care system that contribute to these lagging indicators: persistent poverty in certain parts of the country and among certain subpopulations; chronic un- and underemployment; high levels of income and status inequality; and high levels of social stress and insecurity, for instance. Someone should update the rankings and stress that they measure health status, not the quality of health care systems. If not WHO, who?thehealthcareblog.com ------------ Health Care System Rankings To the Editor: In their Perspective article (Jan. 14 issue),1 Murray and Frenk review a number of indicators of the relatively poor state of the population's health in the United States. Most, if not all, of this information is well known to readers of the Journal, and the authors' use of it is not objectionable. However, Murray and Frenk begin their discussion by referring to the World Health Report 2000, Health Systems: Improving Performance, from the World Health Organization (WHO), which ranked the U.S. health care system 37th in the world, and this is objectionable. (I was editor-in-chief of the World Health Report 2000 but had no control over the rankings of health systems.) Fully 61% of the numbers that went into that ranking exercise were not observed but simply imputed from regressions based on as few as 30 actual estimates from among the 191 WHO member countries. Where the United States is concerned, data were available only for life expectancy and child survival, which together account for only 50% of the attainment measure. Moreover, the "responsiveness" component of attainment cannot be compared across countries, and the estimates of responsiveness for some countries were manipulated. This is not simply a problem of incomplete, inaccurate, or noncomparable data; there are also sound reasons to mistrust the conceptual framework behind the estimates, since it presupposes a production function for health system outcomes that depends only on a country's expenditure on health and its level of schooling, ignoring all cultural, geographic, and historical factors.2 The number 37 is meaningless, but it continues to be cited, for four reasons. First, people would like to trust the WHO and presume that the organization must know what it is talking about. Second, very few people are aware of the reason why in this case that trust is misplaced, partly because the explanation was published 3 years after the report containing the ranking. Third, numbers confer a spurious precision, appealing even to people who have no idea where the numbers came from. Finally, those persons responsible for the number continue to peddle it anyway. To quote Wolfgang Pauli's dismissal of a theory opposed to quantum mechanics, "Not only is it not right, it's not even wrong!" Analyzing the failings of health systems can be valuable; making up rankings among them is not. It is long past time for this zombie number to disappear from circulation. Philip Musgrove, Ph.D. Health Affairs Bethesda, MD No potential conflict of interest relevant to this letter was reported. References 1. Murray CJL, Frenk J. Ranking 37th -- measuring the performance of the U.S. health care system. N Engl J Med 2010;362:98-99. [Free Full Text] 2. Musgrove P. Judging health systems: reflections on WHO's methods. Lancet 2003;361:1817-1820. [CrossRef][Web of Science][Medline]content.nejm.org