Technical Adequacy of the Student Protective Factors Screening Scale (SPF-7) as a Universal Screening Tool


Universal screening is a critical foundation for school-based prevention and early intervention. This study examined the technical adequacy of the SPF-7, an instrument designed to assist school personnel in the early identification of students at-risk for emotional and behavioral concerns. The SPF-7 differs from other measures used in identifying emotionally and behaviorally at-risk students, as the SPF-7 focuses on protective factors rather than risk factors. The results of this study suggest that the SPF-7 has adequate test-retest reliability and criterion validity, but limited inter-rater agreement. The SPF-7 is a potentially promising tool for identifying students in need of support within a multi-tiered system of increasingly intensive interventions.

Share and Cite:

Morrison, J. (2015). Technical Adequacy of the Student Protective Factors Screening Scale (SPF-7) as a Universal Screening Tool. Psychology, 6, 817-832. doi: 10.4236/psych.2015.67081.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] Achenbach, T. (1985). Assessment and Taxonomy Child and Adolescent Psychopathology. Beverly Hills, CA: Sage.
[2] Alvord, M. K., & Grados, J. (2005). Enhancing Resilience in Children: A Proactive Approach. Professional Psychology: Research and Practice, 36, 238-245.
[3] Anderson, C. M., & Kincaid, D. (2005). Applying Behavior Analysis to School Violence and Discipline Problems: School-Wide Positive Behavior Support. Behavior Analyst, 28, 49-63.
[4] Anastasi, A. (1988). Psychological Testing (6th ed.). New York: Macmillan.
[5] Anderman, E. M., & Maehr, M.L. (1994). Motivation and Schooling in the Middle Grades. Review of Educational Research, 64, 287-309.
[6] Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student Engagement with School: Critical Conceptual and Methodological Issues of the Construct. Psychology in the Schools, 45, 369-386.
[7] Barnett, D. W., Daly III, E. J., Jones, K. M., & Lentz Jr., F. (2004). Response to Intervention: Empirically Based Special Service Decisions from Single-Case Designs of Increasing and Decreasing Intensity. Journal of Special Education, 38, 66-79.
[8] Bassarath, L. (2001). Conduct Disorder: A Biopsychosocial Review. Canadian Journal of Psychiatry, 46, 609-616.
[9] Baumeister, R. F., & Leary, M. R. (1995). The Need to Belong: Desire for Interpersonal Attachments as a Fundamental Motivation. Psychological Bulletin, 117, 497-529.
[10] Birch, S., & Ladd, G. W. (1997). The Teacher-Child Relationship and Children’s Early School Adjustment. Journal of School Psychology, 35, 61-79.
[11] Bonny, A. E., Britto, M. T., Klostermann, B. K., Hornung, R. W., & Slap, G. B. (2000). School Disconnectedness Identifying Adolescents at Risk. Pediatrics, 106, 1017-1021.
[12] Booth, A., & Dunn, J. F. (1996). Family-School Links: How Do They Affect Education Outcomes. Mahwah, NJ: Erlbaum.
[13] Brown, B. B., & Huang, G. H. (1995). Examining Parenting Practices in Different Peer Contexts: Implications for Adolescent Trajectories. In L. J. Crockett, & A. C. Crouter (Eds.), Pathways through Adolescence: Relation to Social Contexts (pp. 151-174). Mahwah, NJ: Erlbaum.
[14] Brown-Chidsey, R., & Steeg, M. (2005). Response to Intervention: Principles and Strategies for Effective Practice. New York: Guilford.
[15] Cairns, R. B., Cairns, B. D., Neckerman, H. J., Gest, S. D., & Gariepy, J. L. (1988). Peer Networks and Aggressive Behavior: Peer Support or Peer Rejection? Developmental Psychology, 24, 815-823.
[16] Canter, A. S., Lau, M. Y., & House, A. (2002). Best Practices in Developing Local Norms in Behavioral Assessment. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology, Fourth Edition (pp. 1099-1114). Bethesda, MD: National Association of School Psychologists.
[17] Caprara, G. V., Barbaranelli, C., Pastorelli, C., Bandura, A., & Zimbardo, P. G. (2000). Prosocial Foundations of Children’s Academic Achievement. Psychological Science, 11, 302-306.
[18] Catalano, R. F., & Hawkins, J. D. (1996). The Social Development Model: A Theory of Antisocial Behavior. In J. D. Hawkins (Ed.), Delinquency and Crime: Current Theories (pp. 149-197). New York: Cambridge University Press.
[19] Christenson, S. L., Sinclair, M. F., Lehr, C. A., & Godber, Y. (2001). Promoting Successful School Completion: Critical Conceptual and Methodological Guidelines. School Psychology Quarterly, 16, 468-484.
[20] Clark, R. M. (1993). Homework-Focused Parenting Practices That Positively Affect Student Achievement. In N. F. Chavkin (Ed.), Families and Schools in a Pluralistic Society. Albany, NY: State University of New York Press.
[21] Coie, J. D., & Jacobs, M. R. (1993). The Role of Social Context in the Prevention of Conduct Disorder. Development and Psychopathology, 5, 263-275.
[22] Connell, J. P., Halpern-Felsher, B. L., Clifford, E., Crichlow, W., & Usinger, P. (1995). Hanging in There: Behavioral, Psychological, and Contextual Factors Affecting Whether African American Adolescents Stay in High School. Journal of Adolescent Research, 10, 41-63.
[23] Criss, M. M., Pettit, G. S., Bates, J. E., Dodge, K. A., & Lapp, A. L. (2002). Family Adversity, Positive Peer Relationships, and Children’s Externalizing Behavior: A Longitudinal Perspective on Risk and Resilience. Child Development, 73, 1220-1237.
[24] de Wied, M., Goudena, P. P., & Matthys, W. (2005). Empathy in Boys with Disruptive Behavior Disorders. Journal of Child Psychology and Psychiatry, 46, 867-880.
[25] DiPerna, J., & Elliott, S. N. (2000). Academic Competence Evaluation Scales. San Antonio, TX: Harcourt Assessment.
[26] DiPerna, J. C., Volpe, R. J., & Elliott, S. N. (2002). A Model of Academic Enablers and Elementary Reading/Language Arts Achievement. School Psychology Review, 31, 298-312.
[27] Dishion, T. J., Andrews, D. W., & Crosby, L. (1995). Antisocial Boys and Their Friends in Early Adolescence: Relationship Characteristics, Quality, and Interactional Process. Child Development, 66, 139-151.
[28] Dishion, T. J., Patterson, G. R., Stoolmiller, M., & Skinner, M. L. (1991). Family, School, and Behavioral Antecedents to Early Adolescents Involvement with Antisocial Peers. Developmental Psychology, 27, 172-180.
[29] Doll, B., & Hess, R. S. (2001). Through a New Lens: Contemporary Psychological Perspectives on School Completion and Dropping Out of High School. School Psychology Quarterly, 16, 351-356.
[30] Doll, B., & Lyon, M. A. (1998). Risk and Resilience: Implications for the Delivery of Educational and Mental Health Services in Schools. School Psychology Review, 27, 348-363.
[31] Drummond, T. (1993). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program.
[32] Dunn, C. W., & Tucker, M. (1993). Black Children’s Adaptive Functioning and Maladaptive Behavior Associated with Quality of Family Support. Journal of Multicultural Counseling and Development, 21, 79-87.
[33] Eccles, J. S., Wigfield, A., Midgley, C., Reuman, D., MacIver, D., & Feldlaufer, H. (1993). Negative Effects of Traditional Middle Schools on Students’ Motivation. The Elementary School Journal, 93, 553-574.
[34] Eisenberg, N., Fabes, R. A., Shepard, S. A., Murphy, B. C., Guthrie, I. K., Jones, S., Friedman, J., Poulin, R., & Maszk, P. (1997). Contemporaneous and Longitudinal Prediction of Children’s Social Functioning from Regulation and Emotionality. Child Development, 68, 642-664.
[35] Elliott, S. N., Huai, N., & Roach, A. T. (2007). Universal and Early Screening for Educational Difficulties: Current and Future Approaches. Journal of School Psychology, 45, 137-161.
[36] Epstein, J. L. (1983). Longitudinal Effects of Family-School-Person Interactions on Student Outcomes. In A. Kerckhoff (Ed.), Research in Sociology of Education and Socialization (Vol. 4, pp. 101-128). Greenwich, CT: JAI.
[37] Feil, E. G., Severson, H. H., & Walker, H. M. (2002). Early Screening and Intervention to Prevent the Development of Aggressive, Destructive Behavior Patterns among At-Risk Children. In M. R. Shinn, H. M. Walker, & G. Stoner (Eds.), Interventions for Achievement and Behavior Problems II: Preventive and Remedial Approaches. Bethesda, MD: The National Association of School Psychologists.
[38] Finn, J. D. (1989). Withdrawing from School. Review of Educational Research, 59, 117-142.
[39] Finn, J. D. (1993). School Engagement and Students at Risk. Washington DC: National Center for Education Statistics.
[40] Finn, J. D., & Rock, D. A. (1997). Academic Success among Students at Risk for School Failure. Journal of Applied Psychology, 82, 221-234.
[41] Fredericks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74, 59-109.
[42] Furlong, M. J., Whipple, A. D., St. Jean, G., Simental, J., Soliz, A., & Punthuna, S. (2003). Multiple Contexts of School Engagement: Moving toward a Unifying Framework for Educational Research and Practice. California School Psychologist, 8, 99-114.
[43] Garnefski, N., & Diekstra, W. (1996). Perceived Social Support from Family, School, and Peers: Relationship with Emotional and Behavioral Problems among Adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 35, 1657-1664.
[44] Gresham, F. M. (2002). Best Practices in Social Skills Training. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology IV (pp. 1029-1040). Bethesda, MD: National Association of School Psychologists.
[45] Gresham, F. M. (2004). Current Status and Future Directions of School-Based Behavioral Interventions. School Psychology Review, 33, 326-343.
[46] Gresham, F. M. (2005). Response to Intervention: An Alternative Means of Identifying Students as Emotionally Disturbed. Education and Treatment of Children, 28, 328-344.
[47] Habedank, L. (1995). Best Practices in Developing Local Norms for Problem Solving in the Schools. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology (3rd ed., pp. 701-715). Washington DC: National Association of School Psychologists.
[48] Henricsson, L., & Rydell, A. (2004). Elementary School Children with Behavior Problems: Teacher-Child Relations and Self-Perception. A Prospective Study. Merrill-Palmer Quarterly, 50, 111-138.
[49] Hinshaw, S. (1987). On the Distinction between Attention Deficit/Hyperactivity and Conduct Problems/Aggression in Child Psychopathology. Psychological Bulletin, 101, 443-463.
[50] Hinshaw, S. (1992). Externalizing Behavior Problems and Academic Underachievement in Childhood and Adolescence: Causal Relationships and Underlying Mechanisms. Psychological Bulletin, 111, 127-155.
[51] Horner, R. H., Sugai, G., Todd, A. W., & Lewis-Palmer, T. (2005). School-Wide Positive Behavior Support. In L. Bambara, & L. Kern (Eds.), Individualized Supports for Students with Problem Behaviors: Designing Positive Behavior Plans (pp. 359-390). New York: Guilford Press.
[52] Ikeda, M. J., Neessen, E., & Witt, J. C. (2008). Best Practices in Universal Screening. In A. Thomas, & J. Grimes (Eds.), Best Practices in School Psychology (5th ed., pp. 103-114). Bethesda, MD: National Association of School Psychologists.
[53] Irvin, L. K., Horner, R. H., Ingram, K., Todd, A. W., Sugai, G., Sampson, N. K., et al. (2006). Using Office Discipline Referral Data for Decision Making about Student Behavior in Elementary and Middle Schools: An Empirical Evaluation of Validity. Journal of Positive Behavior Interventions, 8, 10-23.
[54] Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., & Vincent, C. G. (2004). Validity of Office Discipline Referral Measures as Indices of School-Wide Behavioral Status and Effects of School-Wide Behavioral Interventions. Journal of Positive Behavioral Interventions, 6, 131-147.
[55] Jimerson, S. R., Campos, E., & Greif, J. L. (2003). Toward an Understanding of Definitions and Measures of School Engagement and Related Terms. California School Psychologist, 8, 7-27.
[56] Kamphaus, R. W., & Reynolds, C. R. (2007). BASC-2 Behavioral and Emotional Screening System. Minneapolis, MN: Pearson.
[57] Karcher, M. J. (2002). The Cycle of Violence and Disconnection among Rural Middle School Students: Teacher Disconnection as a Consequence of Violence. Journal of School Violence, 1, 35-51.
[58] Karcher, M. J., Davis, C., & Powell, B. (2002). The Effects of Developmental Mentoring on Connectedness and Academic Achievement. School Community Journal, 12, 35-50.
[59] Kavale, K. A., & Forness, S. R. (1998). Covariance in Learning Disability and Behavior Disorder: An Examination of Classification and Placement Issues. In T. E. Scruggs, & M. A. Mastropieri (Eds.), Advances in Learning and Behavioral Disabilities (pp. 1-42). Greenwich, CT: JAI Press.
[60] Kazdin, A. (1987). Treatment of Antisocial Behavior in Children: Current Status and Future Directions. Psychological Bulletin, 102, 187-203.
[61] Kazdin, A. E., Kraemer, H. C., Kessler, R. C., & Kupfer, D. J. (1997). Contributions of Risk-Factor Research to Developmental Psychopathology. Clinical Psychology Review, 17, 375-406.
[62] Kern, L., & Manz, P. (2004). A Look at Current Validity Issues of School-Wide Behavior Support. Behavioral Disorders, 30, 47-59.
[63] Kilgus, S. P., Chafouleas, S. M., &Riley-Tillman, T. C. (2013). Development and Initial Validation of the Social and Academic Behavior Risk Screener for Elementary Grades. School Psychology Quarterly, 28, 210-226.
[64] Kochenderfer, B. J., & Ladd, G. W. (1996). Peer Vicitimization: Cause or Consequence of School Maladjustment? Child Development, 67, 1305-1317.
[65] Kuperminc, G. P., Blatt, S. J., & Leadbeater, B. J. (1997). Relatedness, Self-Definition, and Early Adolescent Adjustment. Cognitive Therapy and Research, 21, 301-320.
[66] Kupersmidt, J. B., & Coie, J. D. (1990). Preadolescent Peer Status, Aggression, and School Adjustment as Predictors of Externalizing Problems in Adolescence. Child Development, 61, 1350-1362.
[67] Kupersmidt, J., Coie, J., & Dodge, K., (1990). The Role of Peer Relationships in the Development of Disorder. In S. Asher, & J. Coie (Eds.), Peer Rejection in Childhood (pp. 274-308). New York: Cambridge University Press.
[68] Ladd, G. W., Kochenderfer, B. J., & Coleman, C. C. (1997). Classroom Peer Acceptance, Friendship, and Victimization: Distinct Relational Systems That Contribute Uniquely to Children’s School Adjustment? Child Development, 68, 1181-1197.
[69] Lane, K. L., Kalberg, J. R., Parks, R. J., & Carter, E. W. (2008). Student Risk Screening Scale: Initial Evidence for Score Reliability and Validity at the High School Level. Journal of Emotional and Behavioral Disorders, 16, 178-190.
[70] Lane, K. L., Menzies, H. M., Oakes, W. P., Kalberg, J. R. (2012). Systematic Screenings of Behavior to Support Instruction: From Preschool to High School. New York: Guilford Press.
[71] Majoribanks, K. (1987). Ability and Attitude Correlates of ACADEMIC achievement: Family Group Differences. Journal of Educational Psychology, 79, 171-178.
[72] Masten, A. S., & Coatsworth, J. D. (1998). The Development of Competence in Favorable and Unfavorable Environments: Lessons from Research on Successful Children. American Psychologist, 53, 205-220.
[73] Malecki, C. K., & Elliott, S. N. (2002). Children’s Social Behaviors as Predictors of Academic Achievement: A Longitudinal Analysis. School Psychology Quarterly, 17, 1-23.
[74] Marston, D. (2005). Tiers of Intervention in Responsiveness to Intervention: Prevention Outcomes and Learning Disabilities Identification Patterns. Journal of Learning Disabilities, 38, 539-544.
[75] Morano, C. D., Cisler, R. A., & Lemerond, J. (1993). Risk Factors for Adolescent Suicidal Behavior: Loss, Insufficient Familial Support, and Hopelessness. Adolescence, 28, 851-865.
[76] Morrison, G. M., Robertson, L., Laurie, B., & Kelly, J. (2002). Protective Factors Related to Antisocial Behavior Trajectories. Journal of Clinical Psychology, 58, 277-290.
[77] Morrison, J. Q., Kobayashi, M., & Bolognone, J. (2007). Use of Protective Factors to Develop Behavioral Norms for English Language Learners. Unpublished manuscript, Dayton, OH: University of Dayton.
[78] Mounts, N. S., & Steinberg, L. (1995). An Ecological Analysis of Peer Influence on Adolescent Grade Point Average and Drug Use. Developmental Psychology, 31, 915-922.
[79] Murray, C., & Greenberg, T. (2000). Children’s Relationship with Teachers and Bonds with School. An Investigation of Patterns and Correlates in Middle Childhood. Journal of School Psychology, 38, 423-445.
[80] National Research Council & Institute of Medicine (2004). Engaging Schools: Fostering High School Students’ Motivation to Learn. Washington DC: The National Academies Press.
[81] Osher, D., Dwyer, K., & Jimerson, S. R. (2006). Safe, Supportive, and Effective Schools: Promoting School Success to Reduce School Violence. In S. R. Jimerson, & M. J. Furlong (Eds.), The Handbook of School Violence and School Safety: From Research to Practice (pp. 51-71). Mahwah, NJ: Lawrence Erlbaum.
[82] Parker, J., & Asher, S. (1987). Peer Relations and Later Personal Adjustment: Are Low-Accepted Children At-Risk? Psychological Bulletin, 102, 357-389.
[83] Patterson, G. R., DeBaryshe, B. D., & Ramsey, E. (1989). A Developmental Perspective on Antisocial Behavior. American Psychologist, 44, 329-335.
[84] Piko, B. F., Fitzpatrick, K. M., & Wright, D. R. (2005). A Risk and Protective Factors Framework for Understanding Youth’s Externalizing Problem Behavior in Two Different Cultural Settings. European Child & Adolescent Psychiatry, 14, 95-103.
[85] Pianta, R. C., Steinberg, M., & Rollins, K. (1995). The First Two Years of School: Teacher-Child Relationships and Deflections in Children’s Classroom Adjustment. Development and Psychopathology, 7, 295-312.
[86] Putnam, R. F., Luiselli, J. K., Handler, M. W., & Jefferson, G. L. (2003). Evaluating Student Discipline Practices in a Public School through Behavioral Assessment of Office Referrals. Behavior Modification, 27, 505-523.
[87] Reschly, A., & Christenson, S. L. (2006a). Promoting Successful School Completion. In G. Bear, & K. Minke (Eds.), Children’s Needs, III: Development, Prevention, and Intervention (pp. 103-113). Bethesda, MD: National Association of School Psychologists.
[88] Reschly, A., & Christenson, S. L. (2006b). Research Leading to a Predictive Model of Dropout and Completion among Students with Mild Disabilities and the Role of Student Engagement. Remedial and Special Education, 27, 276-292.
[89] Reynolds, A. J., & Wahlberg, H. J. (1991). A Structural Model of Science Achievement. Journal of Educational Psychology, 83, 97-107.
[90] Roberts, W., & Strayer, J. (1996). Empathy, Emotional Expressiveness, and Prosocial Behavior. Child Development, 67, 449-470.
[91] Ryan, B. A., Adams, G. R., Gullotta, T. P., Weissberg, R. P., & Hampton, R. L. (1995). The Family-School Connection: Theory, Research and Practice. Thousand Oaks, CA: Sage.
[92] Scott-Jones, D. (1995). Parent-Child Interactions and School Achievement. In B. A. Ryan, G. R. Adams, T. P. Gullotta, R. P. Weissberg, & R. L. Hampton (Eds.), The Family-School Connection: Theory, Research and Practice (Vol. 2, pp. 75-107). Thousand Oaks, CA: Sage.
[93] Severson, H. H., Walker, H. M., Hope-Doolittle, J., Kratochwill, T. R., & Gresham, F. M. (2007). Proactive, Early Screening to Detect Behaviorally At-Risk Students: Issues, Approaches, Emerging Innovations, and Professional Practices. Journal of School Psychology, 45, 193-223.
[94] Smokowski, P. R., Mann, E. A., Reynolds, A. J., & Fraser, M. W. (2004). Childhood Risk and Protective Factors and Late Adolescent Adjustment in Inner City Minority Youth. Children and Youth Services Review, 26, 63-91.
[95] Spoth, R., Yoo, S., Kahn, J. H., & Redmond, C. (1996). A Model of the Effects of Protective Parent and Peer Factors on Young Adolescent Alcohol Refusal Skills. Journal of Primary Prevention, 16, 373-394.
[96] Sprague, J. R., & Horner, R. H. (2006). School Wide Positive Behavioral Supports. In S. R. Jimerson, & M. J. Furlong (Eds.), The Handbook of School Violence and School Safety: From Research to Practice. Mahwah, NJ: Lawrence Erlbaum.
[97] Steinberg, L. (1996). Beyond the Classroom: Why School Reform Has Failed and What Parents Need to Do. New York: Simon & Schuster.
[98] Steinberg, L., Lamborn, S. D., Dornbusch, S. M., & Darling, N. (1992). Impact of Parenting Practices on Adolescent Achievement: Authoritative Parenting, School Involvement, and Encouragement to Succeed. Child Development, 63, 1266-1281.
[99] Steinhausen, H., & Metzke, W. (2001). Risk, Compensatory, Vulnerability, and Protective Factors Influencing Mental Health in Adolescence. Journal of Youth and Adolescence, 30, 259-280.
[100] Stevenson, H. W., Chen, C., & Lee, S. Y. (1993). Mathematics Achievement of Chinese, Japanese, and American Children: Ten Years Later. Science, 259, 53-58.
[101] Stoner, G. (2006). School Psychology and Screening for Problems. The School Psychologist, 60, 104-105, 132.
[102] Strayer, J., & Roberts, W. (2004). Empathy and Observed Anger and Aggression in Five-Year-Olds. Social Development, 13, 1-13.
[103] Sugai, G., & Horner, R. H. (2002). Introduction to the Special Series on Positive Behavior Support in Schools. Journal of Emotional and Behavioral Disorders, 10, 130-135.
[104] Sugai, G., Sprague, J. R., Horner, R. H., & Walker, H. M. (Eds.). (2001). Preventing School Violence: The Use of Office Discipline Referrals to Assess and Monitor School-Wide Discipline Intervention (reprinted chapter). Austin, TX: Pro-Ed, Inc.
[105] Todis, B., Severson, H. H., & Walker, H. M. (1990). The Critical Events Scale: Behavioral Profiles of Students with Externalizing and Internalizing Behavior Disorders. Behavioral Disorders, 15, 75-86.
[106] Walker, H. M., Block-Pedego, A., Todis, B., & Severson, H. (1991). School Archival Records Search. Longmont, CO: Sopris West.
[107] Walker, H. M., Colvin, G., & Ramsey, E. (1995). Antisocial Behavior in School: Strategies and Best Practices. Pacific Grove, CA: Brooks/Cole.
[108] Walker, H. M., & Shinn, M. A. (2002). Structuring School-Based Interventions to Achieve Integrated Primary, Secondary, and Tertiary Prevention Goals for Safe and Effective Schools. In M. Shinn, H. Walker, & G. Stoner (Eds.), Interventions for Academic and Behavior Problems II (pp. 1-26). Bethesda, MD: National Association of School Psychologists.

Copyright © 2022 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.