Using Critical Incidents to Validate the Direct Measurement of Attribute Importance and Performance When Analyzing Services


Since its introduction into the marketing literature by Martilla and James, the Importance-Performance Analysis has proven multiple times to be a cost-effective technique for measuring attribute importance and performance of services for the customer. Additionally, it gives managers valuable hints in order to improve their products and services. However, despite a long list of successful applications overtime one critical aspect remains—the validation of the importance values by direct measurement. Besides the limitations and critics that accompanied with stated importance techniques, a lot of research results show that it is better to use direct methods in place of indirect measures. Some researchers suggest measuring the customers’ priority structure to compensate the critical points within the direct questioning. This study shows how the critical incident technique can be helpful for the validation of such results.

Share and Cite:

S. Löffler and D. Baier, "Using Critical Incidents to Validate the Direct Measurement of Attribute Importance and Performance When Analyzing Services," Journal of Service Science and Management, Vol. 6 No. 5A, 2013, pp. 1-11. doi: 10.4236/jssm.2013.65A001.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] G. A. Churchill and C. Surprenant, “An Investigation into the Determinants of Customer Satisfaction,” Journal of Marketing Research, Vol. 19, No. 4, 1982, pp. 491-504.
[2] R. L. Oliver and W. S. DeSarbo, “Response Determinants in Satisfaction Judgments,” Journal of Consumer Research, Vol. 14, No. 4, 1988, pp. 495-507.
[3] S. A. Neslin, “Linking Product Features to Perceptions: Self-Stated versus Statistically Revealed Importance Weights,” Journal of Marketing Research, Vol. 18, No. 1, 1981, pp. 80-86.
[4] J. Jaccard, D. Brinberg and L. J. Ackerman, “Assessing Attribute Importance: A Comparison of Six Methods,” Journal of Consumer Research, Vol. 12, No. 4, 1986, pp. 463-468.
[5] K. Chrzan and N. Golovashkina, “An Empirical Test of Six Stated Importance Measures,” International Journal of Market Research, Vol. 48, No. 6, 2006, pp. 717-740.
[6] M. I. Alpert, “Identification of Determinant Attributes: A Comparison of Methods,” Journal of Marketing Research, Vol. 8, No. 2, 1971, pp. 184-191.
[7] J. H. Myers and M. I. Alpert, “Determinant Buying Attitudes: Meaning and Measurement,” Journal of Marketing, Vol. 32, No. 4, 1968, pp. 13-20.
[8] J. A. Martilla and J. C. James, “Importance-Performance Analysis,” Journal of Marketing, Vol. 41, No. 1, 1977, pp. 77-79.
[9] J. Abalo, J. Varela and V. Manzano, “Importance Values for Importance-Performance Analysis: A Formula for Spreading out Values Derived from Preference Rankings,” Journal of Business Research, Vol. 60, No. 2, 2007, pp. 115-121.
[10] D. R. Bacon, “A Comparison of Approaches to Importance-Performance Analysis,” International Journal of Market Research, Vol. 45, No. 1, 2003, pp. 55-71.
[11] C. Lovelock, P.G. Patterson and R. H. Walker, “Services Marketing”, Prentice Hall, Sydney, 1998.
[12] R. K. S. Chu and T. Choi, “An Importance-Performance Analysis of Hotel Selection Factors in the Hong Kong Hotel Industry: A Comparison of Business and Leisure Travelers,” Tourism Management, Vol. 21, No. 4, 2000, pp. 363-377.
[13] J. B. Ford, M. Joseph and B. Joseph, “Importance-Performance Analysis as a Strategic Tool for Service Marketers: The Case of Service Quality Perceptions of Business Students in New Zealand and the USA,” Journal of Services Marketing, Vol. 13, No. 2, 1999, pp. 171-186.
[14] F. M. Go and W. Zhang, “Applying Importance-Performance Analysis to Beijing as an International Meeting Destination,” Journal of Travel Research, Vol. 35, No. 4, 1997, pp. 42-49.
[15] M. A. O’Neill and A. Palmer, “Importance-Performance Analysis: A Useful Tool for Directing Continuous Quality Improvement in Higher Education,” Quality Assurance in Education, Vol. 12, No. 1, 2004, pp. 39-52.
[16] S. Alberty and B. J. Mihalik, “The Use of Importance-Performance Analysis as an Evaluative Technique in Adult Education,” Evaluation Review, Vol. 13, No. 1, 1989, pp. 33-44.
[17] D. J. Wade and P. F. Eagles, “The Use of Importance-Performance Analysis and Market Segmentation for Tourism Management in Parks and Protected Areas: An Application to Tanzania’s National Parks,” Journal of Ecotourism, Vol. 2, No. 3, 2003, pp. 196-212.
[18] C. T. Ennew, G. V. Reed and M. R Binks, “Importance-Performance Analysis and the Measurement of Service Quality,” European Journal of Marketing, Vol. 27, No. 2, 1993, pp. 59-70.
[19] U. Yavas and D. J. Shemwell, “Modified Importance-Performance Analysis: An Application to Hospitals,” International Journal of Health Care Quality Assurance, Vol. 14, No. 3, 2001, pp. 104-110.
[20] A. Gustafsson and M. D. Johnson, “Determining Attribute Importance in a Service Satisfaction Model,” Journal of Service Research, Vol. 7, No. 2, 2004, pp. 124-141.
[21] R. L. Oliver, “Satisfaction: A Behavioural Perspective on the Consumer,” McGraw Hill, New York, 1997.
[22] E. Azzopardi and R. Nash, “A Critical Evaluation of Importance-Performance Analysis,” Tourism Management, Vol. 35, 2013, pp. 222-233.
[23] K. Matzler, F. Bailom, H. H. Hinterhuber, B. Renzl and J. Pichler, “The Asymmetric Relationship between Attribute-Level Performance and Overall Customer Satisfaction: A Reconsideration of the Importance-Performance Analysis,” Industrial Marketing Management, Vol. 33, No. 4, 2004, pp. 271-277.
[24] H. Oh, “Revisiting Importance-Performance Analysis,” Tourism Management, Vol. 22, No. 6, 2001, pp. 617-627.
[25] Van Ittersum, J. M. Pennings, B. Wansink and H. Van Trijp, “The Validity of Attribute-Importance Measurement: A Review,” Journal of Business Research, Vol. 60, No. 11, 2007, pp. 1177-1190.
[26] R. J. Fisher, “Social Desirability Bias and the Validity of Indirect Questioning,” Journal of Consumer Research, Vol. 20, No. 2, 1993, pp. 303-315.
[27] M. W. Lowenstein, “Customer Retention: An Integrated Process for Keeping Your Best Customers,” ASQC Quality Press, Milwaukee, 1995.
[28] H. J. Arnold and D. C. Feldman, “Social Desirability Response Bias in Self-Report Choice Situations,” The Academy of Management Journal, Vol. 24, No. 2, 1981, pp. 377-385.
[29] D. N. Sambonmatsu, F. R. Kardes, D. C. Houghton, E. A. Ho and S. S. Posavac, “Overestimating the Importance of the Given Estimation in Multiattribute Consumer Judgment,” Journal of Consumer Psychology, Vol. 13, No. 3, 2003, pp. 289-300.
[30] H. Oh and S. C. Parks, “Evaluating the Role of Attribute Importance as a Multiplicative Weighting Variable in the Study of Hospitality Consumer Decision-Making,” Journal of Hospitality & Tourism Research, Vol. 21, No. 3, 1998, pp. 61-80.
[31] P. A. Bottomley, J. R. Doyle and R. H. Green, “Testing the Reliability of Weight Elicitation Methods: Direct Rating versus Point Allocation,” Journal of Marketing Research, Vol. 37, No. 4, 2000, pp. 508-513.
[32] N. Slack, “The Importance-Performance Matrix as a Determinant of Improvement Priority,” International Journal of Operations & Production Management, Vol. 14, No. 5, 1994, pp. 59-75.
[33] E. Chell, “Critical Incident Technique,” In: G. Symon and C. Cassell, Eds., Qualitative Methods and Analysis in Organizational Research: A Practical Guide, Sage, London, pp. 51-72.
[34] L. K. Woolsey, “The Critical Incident Technique: An Innovative Qualitative Method of Research,” Canadian Journal of Counselling, Vol. 20, No. 4, 1986, pp. 242-254.
[35] H. Hughes, “Critical Incident Technique,” In: S. Lipu, K. Williamson and A. Lloyd, Eds., Exploring Methods in Information Literacy Research, Wagga Wagga, 2007, pp. 49-66.
[36] D. D. Gremler, “The Critical Incident Technique in Service Research”, Journal of Service Research, Vol. 7, No. 1, 2004, pp. 65-89.
[37] J. C. Flanagan, “The Critical Incident Technique,” Psychological Bulletin, Vol. 51, No. 4, 1954, pp. 327-359.
[38] M. J. Bitner, B. H. Booms and M. S. Tetreault, “The Service Encounter: Diagnosing Favorable and Unfavorable Incidents,” The Journal of Marketing, Vol. 54, No. 1, 1990, pp. 71-84.
[39] J. Norman, S. J. Redfern, D. A. Tomalin and S. Oliver, “Developing Flanagan’s Critical Incident Technique to Elicit Indicators of High and Low Quality Nursing Care from Patients and Their Nurses,” Journal of Advanced Nursing, Vol. 17, No. 5, 1992, pp. 590-600.
[40] J. K. Kemppainen, “The Critical Incident Technique and Nursing Care Quality Research,” Journal of Advanced Nursing, Vol. 32, No. 5, 2000, pp. 1264-1271.
[41] E. Chell and L. Pittaway, “A Study of Entrepreneurship in the Restaurant and Café Industry: Exploratory Work Using the Critical Incident Technique as a Methodology,” International Journal of Hospitality Management, Vol. 17, No. 1, 1998, pp. 23-32.
[42] K. Z. Victoroff and S. Hogan, “Students’ Perceptions of Effective Learning Experiences in Dental School: A Qualitative Study Using A Critical Incident Technique,” Journal of Dental Education, Vol. 70, No. 2, 2006, pp. 124-132.
[43] W. L. Stitt-Gohdes, J. J. Lambrecht and D. H. Redmann, “The Critical-Incident Technique in Job Behavior Research,” Journal of Vocational Education Research, Vol. 25, No. 1, 2000, pp. 63-77.
[44] J. F. Petrick, C. Tonner and C. Quinn, “The Utilization of Critical Incident Technique to Examine Cruise Passengers’ Repurchase Intentions,” Journal of Travel Research, Vol. 44, No. 3, 2006, pp. 273-280.
[45] R. J. Callan, “The Critical Incident Technique in Hospitality Research: An Illustration from the UK Lodge Sector,” Tourism Management, Vol. 19, No. 1, 1998, pp. 93-98.
[46] W. W. Ronan and G. P. Latham, “The Reliability and Validity of the Critical Incident Technique: A Closer Look,” Studies in Personnel Psychology, Vol. 6, No. 1, 1974, pp. 53-64.
[47] B. Edvardsson, “Service Breakdowns: A Study Of Critical Incidents in an Airline,” International Journal of Service Industry Management, Vol. 3, No. 4, 1992, pp. 17-29.
[48] B. E. Andersson and S. G. Nilsson, “Studies in the Reliability and Validity of the Critical Incident Technique,” Journal of Applied Psychology, Vol. 48, No. 6, 1964, pp. 398-403.
[49] B. Stauss and B. Weinlich, “Process-Oriented Measurement of Service Quality: Applying the Sequential Incident Technique,” European Journal of Marketing, Vol. 31, No. 1, 1997, pp. 33-55.
[50] S. M. Keaveney, “Customer Switching Behavior in Service Industries: An Exploratory Study,” The Journal of Marketing, Vol. 59, No. 2, 1995, pp. 71-82.
[51] B. Edvardsson and I. Roos, “Critical Incident Techniques: Towards a Framework for Analysing the Criticality of Critical Incidents,” International Journal of Service Industry Management, Vol. 12, No. 3, 2001, pp. 251-268.
[52] B. Stauss, “Service Problem Deployment: Transformation of Problem Information into Problem Prevention Activities,” International Journal of Service Industry Management, Vol. 4, No. 2, 1993, pp. 41-62.
[53] B. Stauss and B. Hentschel, “Attribute-Based Versus Incident-Based Measurement of Service Quality: Results of an Empirical Study within the German Car Service Industry,” In: P. Kunst and J. Lemmink, Eds., Quality Management in Service, Van Gorcum, Assen/Maastricht, 1992, pp. 59-78.
[54] A. Parasuraman, V. A. Zeithaml and L. L. Berry, “SERVQ UAL: A Multiple-Item Scale for Measuring Consumer Perceptions of Service Quality,” Journal of Retailing, Vol. 64, No. 1, 1988, pp. 12-40.
[55] K. Matzler and E. Sauerwein, “The Factor Structure of Customer Satisfaction: An Empirical Test of the Importance Grid and the Penalty-Reward-Contrast Analysis,” International Journal of Service Industry Management, Vol. 13, No. 4, 2002, pp. 314-332.
[56] G. L. Shostack, “How to Design A Service,” European Journal of Marketing, Vol. 16, No. 1, 1982, pp. 49-63.
[57] M. J. Bitner, A. L. Ostrom and F. N. Morgan, “Service Blueprinting: A Practical Technique for Service Innovation,” California Management Review, Vol. 50, No. 3, 2008, pp. 66-94.
[58] M. R. Evans and K. S. Chon, “Formulating and Evaluating Tourism Policy Using Importance-Performance Analysis,” Journal of Hospitality & Tourism Research, Vol. 13, No. 3, 1989, pp. 203-213.
[59] Y. C. Chen and S. Lin, “Applying Importance-Performance Analysis for Improving Internal Marketing of Hospital Management in Taiwan,” International Business Research, Vol. 6, No. 4, 2013, pp. 45-54.
[60] J. E. Swan and C. P. Rao, “The Critical Incident Technique: A Flexible Method for the Identification of Salient Product Attributes,” Journal of the Academy of Marketing Science, Vol. 3, No. 3-4, 1975, pp. 296-308.
[61] H. Q. Zhang and I. Chow, “Application of Importance-Performance Model in Tour Guides’ Performance: Evidence from Mainland Chinese Outbound Visitors in Hong Kong,” Tourism Management, Vol. 25, No. 1, 2004, pp. 81-91.
[62] C. J. Easingwood and D. C. Arnott, “Priorities in Services Marketing,” International Journal of Service Industry Management, Vol. 2, No. 2, 1991, pp. 20-37.
[63] J. M. Hawes, and C. P. Rao, “Using Importance-Performance Analysis to Develop Health Care Marketing Strategies,” Journal of Health Care Marketing, Vol. 5, No. 4, 1985, pp. 19-25.
[64] R. T. Gencer, “The Relationship between Team Identification and Service Quality Perceptions in Professional Football,” African Journal of Business Management, Vol. 5. No. 6, 2010, pp. 2140-2150.
[65] K. A. Hunt, T. Bristol and R. E. Bashaw, “A Conceptual Approach to Classifying Sports Fans,” Journal of Services Marketing, Vol. 13, No. 6, 1999, pp. 439-452.

Copyright © 2023 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.