A New Association Evaluation Stage in Cartoon Apprehension: Evidence from an ERP Study

Shen Tu, Xiaojun Cao, Xuyan Yun, Kangcheng Wang, Guang Zhao, Jiang Qiu

Department of Psychology, Institute of Education, China West Normal University, Nanchong, China.
Donders Institute for Brain, Cognition and Behaviour, Centre for Cognition, Radboud University Nijmegen, Nijmegen, The Netherlands.
Key Laboratory of Cognition and Personality, Ministry of Education, Chongqing, China; Faculty of Psychology, Southwest University, Chongqing, China.
School of Psychology, Liaoning Normal University, Dalian, China.

DOI: 10.4236/jbbs.2014.42010                

Abstract

The aim of this study was to investigate the temporal cortical activation patterns underlying different stages of humor comprehension (e.g., detection of incongruity stage, resolution of incongruity stage, and affective stage). Event-related potentials (ERPs) were measured when 16 subjects were apprehending cartoon pictures including humorous, non-humorous and unrelated items. Results showed that both humorous and unrelated items elicited a more negative ERP deflection (N500-800) than non-humorous ones between 500 - 800 ms, which might reflect detection to incongruent element during humor apprehension. Then, both humorous and non-humorous items elicited a more positive ERP deflection (P800-1000) than unrelated ones between 800 - 1000 ms, which might reflect a classification process preliminarily evaluating whether there were attainable cues in the pictures used to form possible association between context and picture (we named it “association evaluation” stage). Furthermore, humorous items elicited a more positive slow wave than non-humorous items which also elicited a more positive wave than unrelated items between 1000 - 1600 ms, during which this component might be involved in the forming of novel associations (resolution of incongruity). Lastly, between 1600 - 2000 ms, humorous items elicited a more positive ERP deflection (P1600-2000) than both non-humorous and unrelated items, which might be related to emotion processing during humor apprehension. Based on these results, we deeply subdivided the second stage (resolution of incongruity) into two stages: association evaluation and incongruity resolution.

Keywords

Cartoon; Humor Apprehension; Association Evaluation; Event-Related Potentials (ERPs)

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	H. H. Brownell and H. Gardner, “Neuropsychological Insights into Humour,” In: J. Durant and J. Miller, Eds., Laughing Matters: A Serious Look at Humour, Longman Scientific & Technical/Longman Group, Harlow, 1988, pp. 17-34.
[2]	B. G. Celso, D. J. Ebener and E. J. Burkhead, “Humor Coping, Health Status, and Life Satisfaction among Older Adults Residing in Assisted Living Facilities,” Aging & mental Health, Vol. 7, No. 6, 2003, pp. 438-445. http://dx.doi.org/10.1080/13607860310001594691
[3]	J. M. Suls, “A Two-Stage Model for the Appreciation of Jokes and Cartoons: An Information-Processing Analysis,” In: J. H. Goldstein and P. E. McGhee, Eds., The Psychology of Humor: Theoretical Perspectives and Empirical Issues, Academic Press, New York, 1972, pp. 81-100. http://dx.doi.org/10.1016/B978-0-12-288950-9.50010-9
[4]	A. Bartolo, F. Benuzzi, L. Nocetti, P. Baraldi and P. Nichelli, “Humor Comprehension and Appreciation: An FMRI Study,” Journal of Cognitive Neuroscience, Vol. 18, No. 11, 2006, pp. 1789-1798. http://dx.doi.org/10.1162/jocn.2006.18.11.1789
[5]	S. Coulson and M. Kutas, “Getting It: Human Event-Related Brain Response to Jokes in Good and Poor Comprehenders,” Neuroscience Letters, Vol. 316, No. 2, 2001, pp. 71-74. http://dx.doi.org/10.1016/S0304-3940(01)02387-4
[6]	J. Uekermann, S. Channon and I. Daum, “Humor Processing, Mentalizing, and Executive Function in Normal Aging,” Journal of the International Neuropsychological Society, Vol. 12, No. 2, 2006, pp. 184-191. http://dx.doi.org/10.1017/S1355617706060280
[7]	S. Coulson, “Semantic Leaps: Frame-Shifting and Conceptual Blending in Meaning Construction,” Cambridge University Press, Cambridge, 2001. http://dx.doi.org/10.1017/CBO9780511551352
[8]	J. M. Moran, G. S. Wig, R. B. Adams Jr., P. Janata and W. M. Kelley, “Neural Correlates of Humor Detection and Appreciation,” Neuroimage, Vol. 21, No. 3, 2004, pp. 1055-1060. http://dx.doi.org/10.1016/j.neuroimage.2003.10.017
[9]	K. K. Watson, B. J. Matthews and J. M. Allman, “Brain Activation during Sight Gags and Language-Dependent Humor,” Cerebral Cortex, Vol. 17, No. 2, 2007, pp. 314-324. http://dx.doi.org/10.1093/cercor/bhj149
[10]	H. Gardner, P. K. Ling, L. Flamm and J. Silverman, “Comprehension and Appreciation of Humorous Material Following Brain Damage,” Brain: A Journal of Neurology, Vol. 98, No. 3, 1975, pp. 399-412.
[11]	H. H. Brownell, D. Michel, J. Powelson and H. Gardner, “Surprise but Not Coherence: Sensitivity to Verbal Humor in Right-Hemisphere Patients,” Brain and Language, Vol. 18, No. 1, 1983, pp. 20-27. http://dx.doi.org/10.1016/0093-934X(83)90002-0
[12]	A. M. Bihrle, H. H. Brownell, J. A. Powelson and H. Gardner, “Comprehension of Humorous and Nonhumorous Materials by Left and Right Brain-Damaged Patients,” Brain and Cognition, Vol. 5, No. 4, 1986, pp. 399-411. http://dx.doi.org/10.1016/0278-2626(86)90042-4
[13]	P. Shammi and D. T. Stuss, “Humour Appreciation: A Role of the Right Frontal Lobe,” Brain, Vol. 122, No. 4, 1999, pp. 657-666. http://dx.doi.org/10.1093/brain/122.4.657
[14]	V. Goel and R. J. Dolan, “The Functional Anatomy of Humor: Segregating Cognitive and Affective Components,” Nature Neuroscience, Vol. 4, No. 3, 2001, pp. 237-238. http://dx.doi.org/10.1038/85076
[15]	B. Wild, F. A. Rodden, A. Rapp, M. Erb, W. Grodd and W. Ruch, “Humor and Smiling Cortical Regions Selective for Cognitive, Affective, and Volitional Components,” Neurology, Vol. 66, No. 6, 2006, pp. 887-893. http://dx.doi.org/10.1212/01.wnl.0000203123.68747.02
[16]	S. Tu, Y. Ma, G. Zhao, Q. Zhang and J. Qiu, “Dissociation between Incongruity Detection and Resolution in Humor Processing,” Psychological Science, 2014, in Press.
[17]	S. Coulson and C. Lovett, “Handedness, Hemispheric Asymmetries, and Joke Comprehension,” Cognitive Brain Research, Vol. 19, No. 3, 2004, pp. 275-288. http://dx.doi.org/10.1016/j.cogbrainres.2003.11.015
[18]	S. Coulson and E. Severens, “Hemispheric Asymmetry and Pun Comprehension: When Cowboys Have Sore Calves,” Brain and Language, Vol. 100, No. 2, 2007, pp. 172-187. http://dx.doi.org/10.1016/j.bandl.2005.08.009
[19]	S. Coulson and R. F. Williams, “Hemispheric Asymmetries and Joke Comprehension,” Neuropsychologia, Vol. 43, No. 1, 2005, pp. 128-141. http://dx.doi.org/10.1016/j.neuropsychologia.2004.03.015
[20]	S. Coulson and Y. C. Wu, “Right Hemisphere Activation of Joke-Related Information: An Event-Related Brain Potential Study,” Journal of Cognitive Neuroscience, Vol. 17, No. 3, 2005, pp. 494-506. http://dx.doi.org/10.1162/0898929053279568
[21]	X. Du, Y. Qin, S. Tu, H. Yin, T. Wang, C. Yu and J. Qiu, “Differentiation of Stages in Joke Comprehension: Evidence from an ERP Study,” International Journal of Psychology, Vol. 48, No. 2, 2013, pp. 149-157. http://dx.doi.org/10.1080/00207594.2012.665162
[22]	E. Gierych, R. Milner and A. Michalski, “ERP Responses to Smile-Provoking Pictures,” Journal of Psychophysiology, Vol. 19, No. 2, 2005, pp. 77-90. http://dx.doi.org/10.1027/0269-8803.19.2.77
[23]	R. Filik and H. Leuthold, “Processing Local Pragmatic Anomalies in Fictional Contexts: Evidence from the N400,” Psychophysiology, Vol. 45, No. 4, 2008, pp. 554-558. http://dx.doi.org/10.1111/j.1469-8986.2008.00656.x
[24]	A. C. Samson, C. F. Hempelmann, O. Huber and S. Zysset, “Neural Substrates of Incongruity-Resolution and Nonsense Humor,” Neuropsychologia, Vol. 47, No. 4, 2009, pp. 1023-1033. http://dx.doi.org/10.1016/j.neuropsychologia.2008.10.028
[25]	A. C. Samson, S. Zysset and O. Huber, “Cognitive Humor Processing: Different Logical Mechanisms in Nonverbal Cartoons—An fMRI Study,” Social Neuroscience, Vol. 3, No. 2, 2008, pp. 125-140. http://dx.doi.org/10.1080/17470910701745858
[26]	P. Derks, L. S. Gillikin, D. S. Bartolome-Rull and E. H. Bogart, “Laughter and Eletroencephalographic Activity,” Humor, Vol. 10, No. 3, 1997, pp. 285-300. http://dx.doi.org/10.1515/humr.1997.10.3.285
[27]	A. Rodden, B. Wild, M. Erb, M. Titze, W. Ruch and W. Grodd, “Humour, Laughter and Exhilaration Studied with Functional Magnetic Resonance Imaging (fMRI),” Neuroimage, Vol. 13, No. 6, 2001, p. 466. http://dx.doi.org/10.1016/S1053-8119(01)91809-9
[28]	D. Shibata and J. Zhong, “Humour and Laughter: Localization with fMRI,” Neuroimage, Vol. 13, No. 6, 2001, pp. 476. http://dx.doi.org/10.1016/S1053-8119(01)91819-1
[29]	M. Kutas and S. A. Hillyard, “Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity,” Science, Vol. 207, No. 4427, 1980, pp. 203-205. http://dx.doi.org/10.1126/science.7350657
[30]	M. Kutas and K. D. Federmeier, “Electrophysiology Reveals Semantic Memory Use in Language Comprehension,” Trends in Cognitive Sciences, Vol. 4, No. 12, 2000, pp. 463-470. http://dx.doi.org/10.1016/S1364-6613(00)01560-6
[31]	W. C. West and P. J. Holcomb, “Event-Related Potentials during Discourse-Level Semantic Integration of Complex Pictures,” Cognitive Brain Research, Vol. 13, No. 3, 2002, pp. 363-375. http://dx.doi.org/10.1016/S0926-6410(01)00129-X
[32]	G. Ganis, M. Kutas and M. I. Sereno, “The Search for ‘Common Sense’: An Electrophysiological Study of the Comprehension of Words and Pictures in Reading,” Journal of Cognitive Neuroscience, Vol. 8, No. 2, 1996, pp. 89-106. http://dx.doi.org/10.1162/jocn.1996.8.2.89
[33]	G. Ganis and M. Kutas, “An Electrophysiological Study of Scene Effects on Object Identification,” Cognitive Brain Research, Vol. 16, No. 2, 2003, pp. 123-144. http://dx.doi.org/10.1016/S0926-6410(02)00244-6
[34]	K. D. Federmeier and M. Kutas, “Meaning and Modality: Influences of Context, Semantic Memory Organization, and Perceptual Predictability on Picture Processing,” Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol. 27, No. 1, 2001, pp. 202-224. http://dx.doi.org/10.1037/0278-7393.27.1.202
[35]	B. Palmer, V. T. Nasman and G. F. Wilson, “Task Decision Difficulty: Effects on ERPs in a Same-Different Letter Classification Task,” Biological Psychology, Vol. 38, No. 2, 1994, pp. 199-214. http://dx.doi.org/10.1016/0301-0511(94)90039-6
[36]	M. E. Smith, “Neurophysiological Manifestations of Recollective Experience during Recognition Memory Judgments,” Journal of Cognitive Neuroscience, Vol. 5, No. 1, 1993, pp. 1-13. http://dx.doi.org/10.1162/jocn.1993.5.1.1
[37]	M. Besson, M. Kutas and C. Van Petten, “An Event-Related Potential (ERP) Analysis of Semantic Congruity and Repetition Effects in Sentences,” Journal of Cognitive Neuroscience, Vol. 4, No. 2, 1992, pp. 132-149. http://dx.doi.org/10.1162/jocn.1992.4.2.132
[38]	A. Kok, “Event-Related-Potential (ERP) Reflections of Mental Resources: A Review and Synthesis,” Biological Psychology, Vol. 45, No. 1, 1997, pp. 19-56. http://dx.doi.org/10.1016/S0301-0511(96)05221-0
[39]	J. Polich, “Updating P300: An Integrative Theory of P3a and P3b,” Clinical Neurophysiology, Vol. 118, No. 10, 2007, pp. 2128-2148. http://dx.doi.org/10.1016/j.clinph.2007.04.019
[40]	A. Mecklinger and E. Pfeifer, “Event-Related Potentials Reveal Topographical and Temporal Distinct Neuronal Activation Patterns for Spatial and Object Working Memory,” Cognitive Brain Research, Vol. 4, No. 3, 1996, pp. 211-224. http://dx.doi.org/10.1016/S0926-6410(96)00034-1
[41]	J. W. King and M. Kutas, “Who Did What and When? Using Word- and Clause-Level ERPs to Monitor Working Memory Usage in Reading,” Journal of Cognitive Neuroscience, Vol. 7, No. 3, 1995, pp. 376-395. http://dx.doi.org/10.1162/jocn.1995.7.3.376
[42]	S. Berti, H. Geissler, T. Lachmann and A. Mecklinger, “Event-Related Brain Potentials Dissociate Visual Working Memory Processes under Categorial and Identical Comparison Conditions,” Cognitive Brain Research, Vol. 9, No. 2, 2000, pp. 147-155. http://dx.doi.org/10.1016/S0926-6410(99)00051-8
[43]	H. T. Schupp, M. Junghöfer, A. I. Weike and A. O. Hamm, “The Selective Processing of Briefly Presented Affective Pictures: An ERP Analysis,” Psychophysiology, Vol. 41, No. 3, 2004, pp. 441-449. http://dx.doi.org/10.1111/j.1469-8986.2004.00174.x
[44]	M. C. Pastor, M. M. Bradley, A. Löw, F. Versace, J. Moltó and P. J. Lang, “Affective Picture Perception: Emotion, Context, and the Late Positive Potential,” Brain Research, Vol. 1189, 2008, pp. 145-151. http://dx.doi.org/10.1016/j.brainres.2007.10.072
[45]	D. Palomba, A. Angrilli and A. Mini, “Visual Evoked Potentials, Heart Rate Responses and Memory to Emotional Pictorial Stimuli,” International Journal of Psychophysiology, Vol. 27, No. 1, 1997, pp. 55-67. http://dx.doi.org/10.1016/S0167-8760(97)00751-4
[46]	A. Keil, M. M. Bradley, O. Hauk, B. Rockstroh, T. Elbert and P. J. Lang, “Large-Scale Neural Correlates of Affective Picture Processing,” Psychophysiology, Vol. 39, No. 5, 2002, pp. 641-649. http://dx.doi.org/10.1111/1469-8986.3950641
[47]	J. K. Olofsson, S. Nordin, H. Sequeira and J. Polich, “Affective Picture Processing: An Integrative Review of ERP Findings,” Biological Psychology, Vol. 77, No. 3, 2008, pp. 247-265. http://dx.doi.org/10.1016/j.biopsycho.2007.11.006
[48]	B. N. Cuthbert, H. T. Schupp, M. M. Bradley, N. Birbaumer and P. J. Lang, “Brain Potentials in Affective Picture Processing: Covariation with Autonomic Arousal and Affective Report,” Biological Psychology, Vol. 52, No. 2, 2000, pp. 95-111. http://dx.doi.org/10.1016/S0301-0511(99)00044-7