A Psychometric Study of Cognitive Self-Regulation: Are Self-Report Questionnaires and Behavioural Tasks Measuring a Similar Construct?

Abstract

Assessing individual differences in cognitive self-regulation, an effortful process that relies heavily on executive functions, has proven difficult in non-psychiatric populations. We report the results of a psychometric and a behavioural study that investigate convergent, discriminant, and predictive validity of three self-report measures of self-regulation (Adult Temperament Questionnaire, Temperament and Character Inventory, and locus of control (LOC) scale) and two behavioural tasks assessing impulse control and cognitive flexibility respectively. Factor analysis in study 1 (n = 492 college students) indicates that effortful control, persistence and self-directedness measure a similar cognitive self-regulatory construct. Harm avoidance and novelty seeking correlate negatively with cognitive self-regulation while intelligence is independent of cognitive self-regulatory capacity. In study 2 (n = 78 college students), we replicate this factor and test for correlations with behavioural tasks. Only internal LOC correlates positively with impulse control behaviour. We conclude that construct validity of self-reported cognitive self-regulation is robust but that predictive validity is lacking.

Share and Cite:

Waegeman, A. , Declerck, C. & Boone, C. (2014). A Psychometric Study of Cognitive Self-Regulation: Are Self-Report Questionnaires and Behavioural Tasks Measuring a Similar Construct?. Psychology, 5, 2159-2172. doi: 10.4236/psych.2014.519218.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1] Althoff, R. R., Ayer, L. A., Crehan, E. T., Rettew, D. C., Baer, J. R., & Hudziak, J. J. (2012). Temperamental Profiles of Dysregulated Children. Child Psychiatry & Human Development, 43, 511-522.
http://dx.doi.org/10.1007/s10578-012-0280-7
[2] Armbruster, D. J. N., Ueltzhoffer, K., Basten, U., & Fiebach, C. J. (2012). Prefrontal Cortical Mechanisms Underlying Individual Differences in Cognitive Flexibility and Stability. Journal of Cognitive Neuroscience, 24, 2385-2399.
http://dx.doi.org/10.1162/jocn_a_00286
[3] Baumeister, R. F., Vohs, K. D., & Tice, D. M. (2007). The Strength Model of Self-Control. Current Directions in Psychological Science, 16, 351-355.
http://dx.doi.org/10.1111/j.1467-8721.2007.00534.x
[4] Berger, A., Kofman, O., Livneh, U., & Henik, A. (2007). Multidisciplinary Perspectives on Attention and the, Development of Self-Regulation. Progress in Neurobiology, 82, 256-286.
http://dx.doi.org/10.1016/j.pneurobio.2007.06.004
[5] Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Gatchalian, K. M., & McClure, S. M. (2012). Are Executive Function and Impulsivity Antipodes? A Conceptual Reconstruction with Special Reference to Addiction. Psychopharmacology, 221, 361-387.
http://dx.doi.org/10.1007/s00213-012-2689-x
[6] Black, D. W., Shaw, M., McCormick, B., Bayless, J. D., & Allen, J. (2012). Neuropsychological Performance, Impulsivity, ADHD Symptoms, and Novelty Seeking in Compulsive Buying Disorder. Psychiatry Research, 200, 581-587.
http://dx.doi.org/10.1016/j.psychres.2012.06.003
[7] Boone, C., & De Brabander, B. (1993). Generalized vs Specific-Locus of Control Expectancies of Chief Executive Officers. Strategic Management Journal, 14, 619-625.
http://dx.doi.org/10.1002/smj.4250140805
[8] Boone, C., De Brabander, B., Carree, M., de Jong, G., van Olffen, W., & van Witteloostuijn, A. (2002). Locus of Control and Learning to Cooperate in a Prisoner’s Dilemma Game. Personality and Individual Differences, 32, 929-946.
http://dx.doi.org/10.1016/S0191-8869(01)00100-3
[9] Camchong, J., MacDonald, A. W., Nelson, B., Bell, C., Mueller, B. A., Specker, S., & Lim, K. O. (2011). Frontal Hyperconnectivity Related to Discounting and Reversal Learning in Cocaine Subjects. Biological Psychiatry, 69, 1117-1123.
http://dx.doi.org/10.1016/j.biopsych.2011.01.008
[10] Casey, B. J., Somerville, L. H., Gotlib, I. H., Ayduk, O., Franklin, N. T., Askren, M. K., Shoda, Y. et al. (2011). Behavioral and Neural Correlates of Delay of Gratification 40 Years Later. Proceedings of the National Academy of Sciences of the United States of America, 108, 14998-15003.
http://dx.doi.org/10.1073/pnas.1108561108
[11] Christakou, A., Brammer, M., & Rubia, K. (2011). Maturation of Limbic Corticostriatal Activation and Connectivity Associated with Developmental Changes in Temporal Discounting. Neuroimage, 54, 1344-1354.
http://dx.doi.org/10.1016/j.neuroimage.2010.08.067
[12] Cloninger, C. R., Svrakic, D. M., & Przybeck, T. R. (1993). A Psychobiological Model of Temperament and Character. Archives of General Psychiatry, 50, 975-990.
http://dx.doi.org/10.1001/archpsyc.1993.01820240059008
[13] Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2001). Enhanced or Impaired Cognitive Function in Parkinson’s Disease as a Function of Dopaminergic Medication and Task Demands. Cerebral Cortex, 11, 1136-1143.
http://dx.doi.org/10.1093/cercor/11.12.1136
[14] Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002). Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging. Journal of Neuroscience, 22, 4563-4567.
[15] Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A., & Robbins, T. W. (2007). L-dopa Disrupts Activity in the Nucleus Accumbens during Reversal Learning in Parkinson’s Disease. Neuropsychopharmacology, 32, 180-189.
http://dx.doi.org/10.1038/sj.npp.1301153
[16] Crean, J. P., de Wit, H., & Richards, J. B. (2000). Reward Discounting as a Measure of Impulsive Behavior in a Psychiatric Outpatient Population. Experimental and Clinical Psychopharmacology, 8, 155-162.
http://dx.doi.org/10.1037/1064-1297.8.2.155
[17] Dalley, J. W., & Roiser, J. P. (2012). Dopamine, Serotonin and Impulsivity. Neuroscience, 215, 42-58.
http://dx.doi.org/10.1016/j.neuroscience.2012.03.065
[18] de Winter, R. F. P., Wolterbeek, R., Spinhoven, P., Zitman, F. G., & Goekoop, J. G. (2007). Character and Temperament in Major Depressive Disorder and a Highly Anxious-Retarded Subtype Derived from Melancholia. Comprehensive Psychiatry, 48, 426-435.
http://dx.doi.org/10.1016/j.comppsych.2007.04.002
[19] Declerck, C. H., Boone, C., & De Brabander, B. (2006). On Feeling in Control: A Biological Theory for Individual Differences in Control Perception. Brain and Cognition, 62, 143-176.
http://dx.doi.org/10.1016/j.bandc.2006.04.004
[20] Diehl, M., Semegon, A. B., & Schwarzer, R. (2006). Assessing Attention Control in Goal Pursuit: A Component of Dispositional Self-Regulation. Journal of Personality Assessment, 86, 306-317.
http://dx.doi.org/10.1207/s15327752jpa8603_06
[21] Diekhof, E. K., Nerenberg, L., Falkai, P., Dechent, P., Baudewig, J., & Gruber, O. (2012). Impulsive Personality and the Ability to Resist Immediate Reward: An fMRI Study Examining Interindividual Differences in the Neural Mechanisms Underlying Self-Control. Human Brain Mapping, 33, 2768-2784.
http://dx.doi.org/10.1002/hbm.21398
[22] Dodds, C. M., Mueller, U., Clark, L., van Loon, A., Cools, R., & Robbins, T. W. (2008). Methylphenidate Has Differential Effects on Blood Oxygenation Level-Dependent Signal Related to Cognitive Subprocesses of Reversal Learning. Journal of Neuroscience, 28, 5976-5982.
http://dx.doi.org/10.1523/JNEUROSCI.1153-08.2008
[23] Dom, G., De Wilde, B., Hulstijn, W., & Sabbe, B. (2007). Dimensions of Impulsive Behaviour in Abstinent Alcoholics. Personality and Individual Differences, 42, 465-476.
http://dx.doi.org/10.1016/j.paid.2006.08.007
[24] Duckworth, A. L., & Kern, M. L. (2011). A Meta-Analysis of the Convergent Validity of Self-Control Measures. Journal of Research in Personality, 45, 259-268.
http://dx.doi.org/10.1016/j.jrp.2011.02.004
[25] Duijsens, S. P., Goekoop, J. G., Spermon, T., & Eurelings-Bontekoe, E. H. M. (2000). The Dutch Temperament and Character Inventory (TCI): Dimensional Structure, Reliability and Validity in a Normal and Psychiatric Outpatient Sample. Personality and Individual Differences, 28, 487-499.
http://dx.doi.org/10.1016/S0191-8869(99)00114-2
[26] Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. (1999). Working Memory, Short-Term Memory, and General Fluid Intelligence: A Latent-Variable Approach. Journal of Experimental Psychology-General, 128, 309-331.
http://dx.doi.org/10.1037/0096-3445.128.3.309
[27] Ersche, K. D., Barnes, A., Jones, P. S., Morein-Zamir, S., Robbins, T. W., & Bullmore, E. T. (2011). Abnormal Structure of Frontostriatal Brain Systems Is Associated with Aspects of Impulsivity and Compulsivity in Cocaine Dependence. Brain, 134, 2013-2024.
http://dx.doi.org/10.1093/brain/awr138
[28] Evans, D. E., & Rothbart, M. K. (2007). Developing a Model for Adult Temperament. Journal of Research in Personality, 41, 868-888.
http://dx.doi.org/10.1016/j.jrp.2006.11.002
[29] Field, A. (2009). Discovering Statistics Using Spss (3rd ed.). London: Sage.
[30] Freyer, T., Valerius, G., Kuelz, A. K., Speck, O., Glauche, V., Hull, M., & Voderholzer, U. (2009). Test-Retest Reliability of Event-Related Functional MRI in a Probabilistic Reversal Learning Task. Psychiatry Research-Neuroimaging, 174, 40-46.
http://dx.doi.org/10.1016/j.pscychresns.2009.03.003
[31] Heatherton, T. F., & Wagner, D. D. (2011). Cognitive Neuroscience of Self-Regulation Failure. Trends in Cognitive Sciences, 15, 132-139.
http://dx.doi.org/10.1016/j.tics.2010.12.005
[32] Hofmann, W., Schmeichel, B. J., & Baddeley, A. D. (2012). Executive Functions and Self-Regulation. Trends in Cognitive Sciences, 16, 174-180.
http://dx.doi.org/10.1016/j.tics.2012.01.006
[33] Hurst, R. M., Kepley, H. O., McCalla, M. K., & Livermore, M. K. (2011). Internal Consistency and Discriminant Validity of a Delay-Discounting Task with an Adult Self-Reported ADHD Sample. Journal of Attention Disorders, 15, 412-422.
http://dx.doi.org/10.1177/1087054710365993
[34] Joireman, J., Balliet, D., Sprott, D., Spangenberg, E., & Schultz, J. (2008). Consideration of Future Consequences, Ego-Depletion, and Self-Control: Support for Distinguishing Between CFC-Immediate and CFC-Future Sub-Scales. Personality and Individual Differences, 45, 15-21.
http://dx.doi.org/10.1016/j.paid.2008.02.011
[35] Judge, T. A. (2009). Core Self-Evaluations and Work Success. Current Directions in Psychological Science, 18, 58-62.
http://dx.doi.org/10.1111/j.1467-8721.2009.01606.x
[36] Kehagia, A. A., Murray, G. K., & Robbins, T. W. (2010). Learning and Cognitive Flexibility: Frontostriatal Function and Monoaminergic Modulation. Current Opinion in Neurobiology, 20, 199-204.
http://dx.doi.org/10.1016/j.conb.2010.01.007
[37] Kirby, K. N. (2009). One-Year Temporal Stability of Delay-Discount Rates. Psychonomic Bulletin & Review, 16, 457-462.
http://dx.doi.org/10.3758/PBR.16.3.457
[38] Kline, T. J., Sulsky, L. M., & Rever-Moriyama, S. D. (2000). Common Method Variance and Specification Errors: A Practical Approach to Detection. Journal of Psychology, 134, 401-421.
http://dx.doi.org/10.1080/00223980009598225
[39] Lewis, M. D., & Todd, R. M. (2007). The Self-Regulating Brain: Cortical-Subcortical Feedback and the Development of Intelligent Action. Cognitive Development, 22, 406-430.
http://dx.doi.org/10.1016/j.cogdev.2007.08.004
[40] McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate Neural Systems Value Immediate and Delayed Monetary Rewards. Science, 306, 503-507.
http://dx.doi.org/10.1126/science.1100907
[41] Mischel, W., Ayduk, O., Berman, M. G., Casey, B. J., Gotlib, I. H., Jonides, J., & Shoda, Y. (2011). “Willpower” over the Life Span: Decomposing Self-Regulation. Social Cognitive and Affective Neuroscience, 6, 252-256.
http://dx.doi.org/10.1093/scan/nsq081
[42] Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989). Delay of Gratification in Children. Science, 244, 933-938.
http://dx.doi.org/10.1126/science.2658056
[43] Moeller, F. G., Dougherty, D. M., Barratt, E. S., Oderinde, V., Mathias, C. W., Harper, R. A., & Swann, A. C. (2002). Increased Impulsivity in Cocaine Dependent Subjects Independent of Antisocial Personality Disorder and Aggression. Drug and Alcohol Dependence, 68, 105-111.
http://dx.doi.org/10.1016/S0376-8716(02)00106-0
[44] Moreira, P. A., Oliveira, J. T., Cloninger, K. M., Azevedo, C., Sousa, A., Castro, J., & Cloninger, C. R. (2012). The Psychometrics and Validity of the Junior Temperament and Character Inventory in Portuguese Adolescents. Comprehensive Psychiatry, 53, 1227-1236.
http://dx.doi.org/10.1016/j.comppsych.2012.04.014
[45] Muraven, M., & Baumeister, R. F. (2000). Self-Regulation and Depletion of Limited Resources: Does Self-Control Resemble a Muscle? Psychological Bulletin, 126, 247-259.
http://dx.doi.org/10.1037/0033-2909.126.2.247
[46] Muraven, M., Tice, D. M., & Baumeister, R. F. (1998). Self-Control as Limited Resource: Regulatory Depletion Patterns. Journal of Personality and Social Psychology, 74, 774-789.
http://dx.doi.org/10.1037/0022-3514.74.3.774
[47] Nagano-Saito, A., Leyton, M., Monchi, O., Goldberg, Y. K., He, Y., & Dagher, A. (2008). Dopamine Depletion Impairs Frontostriatal Functional Connectivity during a Set-Shifting Task. Journal of Neuroscience, 28, 3697-3706.
http://dx.doi.org/10.1523/JNEUROSCI.3921-07.2008
[48] O’Connor, P. J., & Jackson, C. J. (2010). Applying a Psychobiological Model of Personality to the Study of Leadership. Journal of Individual Differences, 31, 185-197.
http://dx.doi.org/10.1027/1614-0001/a000027
[49] Posner, M. I., & Rothbart, M. K. (2009). Toward a Physical Basis of Attention and Self-Regulation. Physics of Life Reviews, 6, 103-120.
http://dx.doi.org/10.1016/j.plrev.2009.02.001
[50] Previc, F. H. (2009). The Dopaminergic Mind in Human Evolution and History. Cambridge: Cambridge University Press.
http://dx.doi.org/10.1017/CBO9780511581366
[51] Reynolds, B., Ortengren, A., Richards, J. B., & de Wit, H. (2006). Dimensions of Impulsive Behavior: Personality and Behavioral Measures. Personality and Individual Differences, 40, 305-315.
http://dx.doi.org/10.1016/j.paid.2005.03.024
[52] Rothbart, M. K., Ahadi, S. A., & Evans, D. E. (2000). Temperament and Personality: Origins and Outcomes. Journal of Personality and Social Psychology, 78, 122-135.
http://dx.doi.org/10.1037//0022-3514.78.1.122
[53] Rotter, J. B. (1966). Generalized Expectancies for Internal versus External Control of Reinforcement. Psychological Monographs, 80, 1-28.
http://dx.doi.org/10.1037/h0092976
[54] Sizoo, B., van den Brink, W., van Eenige, M. G., & van der Gaag, R. J. (2009). Personality Characteristics of Adults with Autism Spectrum Disorders or Attention Deficit Hyperactivity Disorder with and without Substance Use Disorders. Journal of Nervous and Mental Disease, 197, 450-454.
http://dx.doi.org/10.1097/NMD.0b013e3181a61dd0
[55] Smillie, L. D., Cooper, A. J., Tharp, I. J., & Pelling, E. L. (2009). Individual Differences in Cognitive Control: The Role of Psychoticism and Working Memory in Set-Shifting. British Journal of Psychology, 100, 629-643.
http://dx.doi.org/10.1348/000712608X382094
[56] Sripada, C. S., Gonzalez, R., Phan, K. L., & Liberzon, I. (2011). The Neural Correlates of Intertemporal Decision-Making: Contributions of Subjective Value, Stimulus Type, and Trait Impulsivity. Human Brain Mapping, 32, 1637-1648.
http://dx.doi.org/10.1002/hbm.21136
[57] Stuss, D. T., & Levine, B. (2002). Adult Clinical Neuropsychology: Lessons from Studies of the Frontal Lobes. Annual Review of Psychology, 53, 401-433.
http://dx.doi.org/10.1146/annurev.psych.53.100901.135220
[58] Vervaet, M., van Heeringen, C., & Audenaert, K. (2004a). Is Drive for Thinness in Anorectic Patients Associated with Personality Characteristics? European Eating Disorders Review, 12, 375-379.
http://dx.doi.org/10.1002/erv.586
[59] Vervaet, M., van Heeringen, C., & Audenaert, K. (2004b). Personality-Related Characteristics in Restricting versus Binging and Purging Eating Disordered Patients. Comprehensive Psychiatry, 45, 37-43.
http://dx.doi.org/10.1016/j.comppsych.2003.09.008
[60] Wechsler, D. (1997). Wechsler Adult Intelligence Scale: Technical and Interpretive Manual (3rd ed.). San Antonio, TX: The Psychological Corporation.
[61] Zhu, J. J., Weiss, L. G., Prifitera, A., & Coalson, D. (2003). The Wechsler Intelligence Scales for Children and Adults. In S. N. Haynes, E. M. Heiby, & M. Hersen (Eds.), Comprehensive Handbook of Psychological Assessment (pp. 51-75). Hoboken, NJ: John Wiley & Sons, Inc.

Journals Menu
Follow SCIRP
Contact us
+1 323-425-8868
customer@scirp.org
WhatsApp +86 18163351462(WhatsApp)
Click here to send a message to me 1655362766
Paper Publishing WeChat

Copyright © 2023 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.