Construct-Validity of the Engagement with Challenge Measure for Adolescents: Structural- and Criterion-Validity Evidence

E. Whitney G. Moore, David Hansen

Health, Sport & Exercise Sciences Department, University of Kansas, Lawrence, USA.
Psychology & Research in Education Department, University of Kansas, Lawrence, USA.

DOI: 10.4236/psych.2012.310139                

Abstract

or adolescents, engaging with challenge is a key developmental task, hypothesized to support development of adult-like competencies (e.g., agency and self-direction; Larson, 2000). This study aimed to assess the construct-validity (structural- and concurrent-validity) of a new self-report measure assessing adolescents’ engagement with challenge to help researchers understand how different settings and the conditions in these settings support adolescents’ development. The sample consisted of 337 adolescents in 10 FFA programs along with the adult advisors in each program. Adolescents completed a questionnaire, which included the Engagement with Challenge measure and the following criterion variables: number of contests completed, participation frequency, and leadership roles. In addition to the self-reported criterion variables, the adult advisor evaluated Engagement with Challenge for each FFA student member in that program using a single item. The findings of this study provided strong evidence for the structural-validity of the engagement with challenge construct measured by the new scale, including having passed confirmatory factor analysis configural, weak, and strong invariance tests across four grade groupings. The findings also provided further evidence of construct-validity, as Engagement with Challenge correlated in the a priori hypothesized direction and magnitude. Suggestions for analysis with the new measure and for future research are presented.

Keywords

Adolescent; Engagement; Challenge; Cognitive Development; Out-of-School Time

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
[2]	Clark, L. & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319.
[3]	Csikszentmihalyi, M., & Larson, R. W. (1984). Being adolescent. New York: Basic Books.
[4]	Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York: Harper Perennial.
[5]	Cury, F., Elliot, A. J., Sarrazin, P., DaFonseca, D., & Rufo, M. (2002). The trichotomous achievement goal model and intrinsic motivation: A sequential mediational analysis. Journal of Experimental Social Psychology, 38, 473-381.
[6]	Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-de- termination in human behavior. New York: Plenum.
[7]	Eccles, J., Barber, B., Stone, M., & Hunt, J. (2003). Extracurricular activities in adolescent development. Journal of Social Issues, 59, 865-889.
[8]	Eccles, J., & Gootman, J. A. (Eds.) (2002). Community programs to promote youth development. Committee on community-level pro- grams for youth. Washington: National Academy Press.
[9]	Elliot, A. J., Cury, F., Fryer, J. W., & Huguet, P. (2006). Achievement goals, self-handicapping, and performance attainment: A mediational analysis. Journal of Sport and Exercise Psychology, 28, 344-361.
[10]	Jay, G. (2009) The teen brain: Primed to learn, primed to take risks. Cerebrum. URL (last checked 26 February 2009). http://bit.ly/GieddPrimed
[11]	Giedd, J. N., Blumenthal, J., Jeffries, N. O., Castellanos, F. X., Liu, H., Zijdenbos, A., Paus, T., Evans, A. C., & Rapoport, J. L. (1999). Brain development during childhood and adolescence: A longitudinal MRI study. Nature Neuroscience, 2, 861-863.
[12]	Goldberg, E. (2009). The new executive brain: Frontal lobes in a complex world. Oxford: Oxford University Press.
[13]	Gottfried, A. E., Fleming, J. S., & Gotfried, A. W. (1998). Role of cognitively stimulating home environment in children’s academic intrinsic motivation: A longitudinal study. Child Development, 69, 1148-1460.
[14]	Guay, F., Boggiano, A. K., & Vallerand, R. J. (2001). Autonomy support, intrinsic motivation, and perceived competence: Conceptual and empirical linkages. Personality and Social Psychology Bulletin, 6, 643-650.
[15]	Hansen, D. M., & Larson, R. (2007). Amplifiers of developmental and negative experiences in organized activities: Dosage, motivation, lead roles, and adult-youth ratios. Journal of Applied Developmental Psychology, 28, 360-374.
[16]	Hansen, D. M., Larson, R., & Dworkin, J. (2003). What adolescents learn in organized youth activities: A survey of self-reported developmental experiences. Journal of Research on Adolescence, 13, 25- 55.
[17]	Keating, D. (2004). Cognitive and brain development. In R. Lerner, & L. Steinberg (Eds.), Handbook of Adolescent Psychology (2nd ed., pp. 45-84). Hoboken, NJ: Wiley & Sons.
[18]	Kuhn, D. & Franklin, S. (2006). The second decade: What develops and how. Handbook of Child Psychology (6th ed., pp. 953-993), New York: Wiley.
[19]	Larson, R. W., & Angus, R. M. (2011). Adolescents’ development of skills for agency in youth programs: Learning to think strategically. Child Development, 82, 277-294.
[20]	Larson, R., & Hansen, D. (2005). The development of strategic thinking: Learning to impact human systems in a Youth Activism program. Human Development, 48, 327-349.
[21]	Larson, R. (2000). Towards a psychology of positive youth development. American Psychologist, 55, 170-183.
[22]	Larson, R., Hansen, D., & Moneta, G. (2006). Differing profiles of developmental experiences in across types of organized youth activities. Developmental Psychology, 42, 849-863.
[23]	Larson, R., Hansen, D., & Walker, K. (2005). Everybody’s gotta give: Adolescents’ development of initiative within a youth program. In J. Mahoney, R. Larson, & J. Eccles (Eds.), Organized activities as contexts of development: Extracurricular activities, after-school and community programs. Hillsdale, NJ: Erlbaum.
[24]	Larson, R. W., & Rusk, N. (in press) Intrinsic motivation and positive development. In R. M. Lerner, J. V. Lerner, & J. B. Benson (Eds.), Advances in Child Development and Behavior: Positive Youth Development. Oxford: Elsevier.
[25]	Little, T. D. (2010). Structural equation modeling: Foundations and extended applications. Lawrence, KS: University of Kansas.
[26]	Little, T. D. (in press). Longitudinal structural equation modeling: Individual difference panel models. New York: Guilford Press.
[27]	Loevinger, J. (1954). The attenuation paradox in test theory. Psychological Bulletin, 51, 493-504.
[28]	Markham, J. & Greenbough, W. (2004). Experience driven brain plasticity: Beyond the synapse. Neuron Glia Biology, 1, 351-363.
[29]	Mascolo, M. F., Fisher, K. W., & Neimeyer, R. (1999). The dynamic co-development of intentionality, self, and social relations. In J. Brandst?dter, & R. M. Lerner (Eds.), Action and Self-Development: Theory and Research through the Life Span. Thousand Oaks, CA: Sage.
[30]	Morris, R. L., & Kayussanu, M. (2009). Approach-avoidance achievement goals in sport: Psychological correlates and a comparison with the dichotomous model. International Journal of Sport and Exercise Psychology, 9, 185-202.
[31]	Muthen, L. K., & Muthen, B. O. (1998-2009). Mplus (Version 5.21) [Base Program (32-bit)]. Los Angeles, CA: Muthen & Muthen.
[32]	National Research Council & Institute of Medicine (2002). Community programs to promote youth development. Washington, DC: National Academy Press.
[33]	Olinsky, A., Chen, S., & Harlow, L. (2003). The comparative efficacy of imputation methods for missing data in structural equation modeling. European Journal of Operation Research, 151, 53-79.
[34]	Pearce, N., & Larson, R. (2006). The process of motivational change in a civic activism organization. Applied Developmental Science, 10, 121-131.
[35]	R Development Core Team (2010). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
[36]	Richards, J. E., Reynolds, G. D., & Courage, M. L. (2010). The neural bases of infant attention. Current Directions in Psychological Science, 19, 41-46.
[37]	Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well- being. American Psychologist, 55, 68-78.
[38]	Spear, L. P. (2000). The adolescent brain and age-related behavioral manifestations. Neuroscience and Biobehavioral Reviews, 24, 417- 463.
[39]	Vallerand, R. J. (1997). Toward a hierarchical model of intrinsic and extrinsic motivation. In M. P. Zanna (Ed.), Advances in Experimental Social Psychology (pp. 271-360). New York: Academic Press.
[40]	Wu, W., Lang, K. M., & Little, T. D. (2009, October). A simple method of assessing fit and significance in multiply imputed data. Annual Meeting of the Society of Multivariate Experimental Psychology.
[41]	Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s, Revelle’s, and McDonald’s: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123- 133.