Detecting When “Quality of Life” Has Been “Enhanced”: Estimating Change in Quality of Life Ratings

Rochelle E. Tractenberg, Futoshi Yumoto, Paul S. Aisen

Collaborative for Research on Outcomes and—Metrics IMPAQ International, Columbia, USA.
Department of Neurology, University of California, San Diego, USA.
Departments of Neurology, Biostatistics, Bioinformatics & Biomathematics, and Psychiatry, Georgetown University Medical Center, Washington, D.C., USA; Collaborative for Research on Outcomes and—Metrics 3IMPAQ International, Columbia, USA.

DOI: 10.4236/ojpp.2013.34A005                

Abstract

Objective: To demonstrate challenges in the estimation of change in quality of life (QOL). Methods: Data were taken from a completed clinical trial with negative results. Responses to 13 QOL items were obtained 12 months apart from 258 persons with Alzheimer’s disease (AD) participating in a randomized, placebo-controlled clinical trial with two treatment arms. Two analyses to estimate whether “change” in QOL occurred over 12 months are described. A simple difference (later - earlier) was calculated from total scores (standard approach). A Qualified Change algorithm (novel approach) was applied to each item: differences in ratings were classified as either: improved, worsened, stayed poor, or stayed “positive” (fair, good, excellent). The strengths of evidence supporting a claim that “QOL changed”, derived from the two analyses, were compared by considering plausible alternative explanations for, and interpretations of, results obtained under each approach. Results: Total score approach: QOL total scores decreased, on average, in the two treatment (both ?1.0, p < 0.05), but not the placebo (=?0.59, p > 0.3) groups. Qualified change approach: Roughly 60% of all change in QOL items was worsening in every arm; 17% - 42% of all subjects experienced change in each item. Conclusions: Totalling the subjective QOL item ratings collapses over items, and suggests a potentially misleading “overall” level of change (or no change, as in the placebo arm). Leaving the items as individual components of “quality” of life they were intended to capture, and qualifying the direction and amount of change in each, suggests that at least 17% of any group experienced change on every item, with 60% of all observed change being worsening. Discussion: Summarizing QOL item ratings as a total “score” collapses over the face-valid, multi-dimensional components of the construct “quality of life”. Qualified Change provides robust evidence of changes to QOL or “enhancements of” life quality.

Keywords

Longitudinal Analysis; Statistical Method; Scale Type; Data Interpretation

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Bentham J. (1834). Deontology; or The science of Morality. London, UK: Longman, Reese, Orme, Borwne, Green & Longman.
[2]	Brown, M. M., & Brown, G. C. (2013). Update on value-based medicine. Current Opinion in Ophthalmology, 24, 183-189. http://dx.doi.org/10.1097/ICU.0b013e32835ff189
[3]	De Gruiter, D. N., & van der Kamp, L. J. T. (2008). Statistical test theory for the behavioral sciences. Boca Raton, FL: Chapman & Hall/ CRC.
[4]	de Vet, H. C., Terwee, C. B., & Bouter, L. M. (2003). Current challenges in clinimetrics. Journal of Clinical Epidemiology, 56, 11371141. http://dx.doi.org/10.1016/j.jclinepi.2003.08.012
[5]	de Vet, H. C., Terwee, C. B., Ostelo, R. W., Beckerman, H., Knol, D. L., & Bouter, L. M. (2006). Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change. Health and Quality of Life Outcomes, 22, 4-54.
[6]	Embretson, S. E., & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Earlbaum Associates.
[7]	Ettema, T. P., Dr?es, R.-M., de Lange, J., Mellenbergh, G. J., & Ribbe, M. W. (2005). A review of quality of life instruments used in dementia. Quality of Life Research, 14, 675-686. http://dx.doi.org/10.1007/s11136-004-1258-0
[8]	Fava, G. A., & Belaise, C. (2005). A discussion on the role of clinimetrics and the misleading effects of psychometric theory. Journal of Clinical Epidemiology, 58, 753-756. http://dx.doi.org/10.1016/j.jclinepi.2004.12.006
[9]	Frei, A., Svarin, A., Steurer-Stey, C., & Puhan, M. A. (2009). Selfefficacy instruments for patients with chronic diseases suffer from methodological limitations—A systematic review. Health and Quality of Life Outcomes, 7, 86-95. http://dx.doi.org/10.1186/1477-7525-7-86
[10]	Garcia, S. F., Cella, D., Clauser, S. B., Flynn, K. E., Lad, T., Lai, J. S., Reeve, B. B., Smith, A. W., Stone, A. A., & Weinfurt, K. (2007). Standardizing patient-reported outcomes assessment in cancer clinical trials: A patient-reported outcomes measurement information system initiative. Journal of Clinical Oncology, 25, 5106-5112. http://dx.doi.org/10.1200/JCO.2007.12.2341
[11]	Hand, D. J. (2004). Measurement theory and practice: The world through quantification. London, UK: Arnold.
[12]	Howard, J. S., Mattacola, C. G., Howell, D. M., & Lattermann, C. (2011). Response shift theory: An application for health-related quality of life in rehabilitation research and practice. Journal of Allied Health, 40, 31-38.
[13]	Kuhn, T. S. (1996). The structure of scientific revolutions (3rd ed.). Chicago, IL: University of Chicago Press. http://dx.doi.org/10.7208/chicago/9780226458106.001.0001
[14]	Logsdon, R. G., Gibbons, L. E., McCurry, S. M., & Teri, L. (1999). Quality of life in Alzheimer’s disease: Patient and caregiver reports. Journal of Mental Health and Aging, 5, 21-32.
[15]	Logsdon, R. G., Gibbons, L. E., McCurry, S. M., et al. (2004). Assessing changes in QOL in AD. 9th International Conference on Alzheimer’s Disease and Related Disorders.
[16]	Meyer, K. B., & Clayton, K. A. (2009). Measurement and analysis of patient-reported outcomes. Methods in Molecular Biology, 473, 155169. http://dx.doi.org/10.1007/978-1-59745-385-1_9
[17]	Mislevy, R. J. (2003). Substance and structure in assessment arguments. Law, Probability and Risk, 2, 237-258. http://dx.doi.org/10.1093/lpr/2.4.237
[18]	Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
[19]	Revicki, D. A., & Cella, D. F. (1997). Health status assessment for the twenty-first century: Item response theory, item banking and computer adaptive testing. Quality of Life Research, 6, 595-600. http://dx.doi.org/10.1023/A:1018420418455
[20]	Rothman, M., Burke, L., Erickson, P., Leidy, N. K., Patrick, D. L., & Petrie, C. D. (2009). Use of existing patient-reported outcome (PRO) instruments and their modification: The ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value in Health, 12, 1075-83. http://dx.doi.org/10.1111/j.1524-4733.2009.00603.x
[21]	Schwartz, C. E. (2010). Applications of response shift theory and methods to participation measurement: A brief history of a young field. Archives of Physical Medicine and Rehabilitation, 91, S38-43. http://dx.doi.org/10.1016/j.apmr.2009.11.029
[22]	Schwartz, C. E., Sprangers, M. A., Oort, F. J., Ahmed, S., Bode, R., Li, Y., & Vollmer, T. (2011). Response shift in patients with multiple sclerosis: an application of three statistical techniques. Quality of Life Research, 20, 1561-72. http://dx.doi.org/10.1007/s11136-011-0056-8
[23]	Sheskin, D. J. (2004). Handbook of parametric and nonparametric statistical procedures (4th ed.). Boca Raton, FL: Chapman & Hall/ CRC.
[24]	Stevens, S. S. (1946). On the theory of scales and measurement. Science, 103, 677-680. http://dx.doi.org/10.1126/science.103.2684.677
[25]	Streiner, D. L. (2003). Clinimetrics vs. psychometrics: An unnecessary distinction. Journal of Clinical Epidemiology, 56, 1142-1145. http://dx.doi.org/10.1016/j.jclinepi.2003.08.011
[26]	Terwee, C. B., Dekker, F. W., Wiersinga, W. M., Prummel, M. F., & Bossuyt, P. M. M. (2003). On assessing responsiveness of healthrelated quality of life instruments: Guidelines for instrument evaluation. Quality of Life Research, 12, 349-362. http://dx.doi.org/10.1023/A:1023499322593
[27]	Tractenberg, R. E., Chaterji, R., & Haramati, A. (2007). Assessing and analyzing change in attitudes in the classroom. Assessment and Evaluation in Higher Education, 32, 107-120. http://dx.doi.org/10.1080/02602930600800854
[28]	Tractenberg, R. E., Jin, S., Patterson, M., Schneider, L. S., Gamst, A. G., Thomas, R. G., & Thal, L. J. (2000). Qualifying change: A method for defining “clinically-meaningful” outcomes of change score computation. Journal of the American Geriatrics Society, 48, 14781482.
[29]	Tractenberg, R. E., Gamst, A., Thomas, R. G., Patterson, M. B., Schneider, L. S., & Thal, L. J. (2002). Investigating emergent symptomatology as an outcome measure in a behavioral study of Alzheimer’s disease. Journal of Neuropsychiatry and Clinical Neuroscience, 14, 303-310. http://dx.doi.org/10.1176/appi.neuropsych.14.3.303
[30]	Waters, D., & Sierpina, V. S. (2006). Goal-Directed Health Care and the chronic pain patient: A new vision of the healing encounter. Pain Physician, 9, 353-60.
[31]	WHOQOL Group (1993). Measuring Quality of Life: The development of the World Health Organization Quality of Life Instrument. Geneva: WHO.