Objective: The purpose of the current study was to examine the practice validity of a new ecological assessment instrument for third through fifth graders in terms of whether it provided school staff with new knowledge about students. Method: Preassessment knowledge of school staff was compared to data obtained from 21 children and their parents on 29 measures. Data were collected using the Elementary School Success Profile. School staff preassessment knowledge was compared to obtained data across seven domains of children’s lives (neighborhood, school, family, peers, parent educational involvement, well-being, and home behavior), data sources (child and parent), and grade level of students. Results: Preassessment knowledge was not highly correlated with obtained data; preassessment expectations matched obtained data only about 41% of the time, and knowledge varied by domain, source, and grade level. Conclusions: Ecological assessments can address gaps in school staff’s knowledge of targetable factors that influence the success of students.
Benjamini, Y., Drai, D., Elmer, G., Kafkafi, N., & Golani, I. (2001). Controlling the false discovery rate in behavior genetics research. Behavioural Brain Research, 125, 279-284.
2.
Bowen, G. L., Richman, J. M., & Bowen, N. K. (2002). The School Success Profile: A results management approach to assessment and intervention planning. In A. L. Roberts & G. J. Greene (Eds.), Social workers’ desk reference (pp. 787-793). New York: Oxford University Press.
3.
Bowen, N. K. (2004). Psychometric properties of the Elementary School Success Profile’s child questionnaire. Manuscript submitted for publication.
4.
Bowen, N. K., Bowen, G. L., & Woolley, M. E. (2004). Constructing and validating assessment tools for school-based practitioners: The Elementary School Success Profile. In A. R. Roberts & K. R. Yeager (Eds.), Evidence-based practice manual: Research and outcome measures in health and human services (pp. 509-517). New York: Oxford University Press.
5.
Bronfenbrenner, U. (1986). Ecology of the family as a context for human development: Research perspectives. Developmental Psychology, 22, 723-742.
6.
Cohen, J.(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
7.
DeVellis, R. F. (1991). Scale development: Theory and applications. Newbury Park, CA: Sage.
8.
Gagnon, S. G., & Nagle, R. J. (2004). Relationships between peer interactive play and social competence in at-risk preschool children. Psychology in the Schools, 41, 173-189.
9.
Gambrill, E. (1999). Evidence-based practice: An alternative to authority-based practice. Families in Society: The Journal of Contemporary Human Services, 80, 341-350.
10.
Gonzales, N. A., Cauce, A. M., Friedman, R. J., & Mason, C. A. (1996). Family, peer, and neighborhood influences on academic achievement among African-American adolescents: One year prospective effects. American Journal of Community Psychology, 24, 365-388.
11.
Greenburg, M. T., Domitrovich, C., & Bumbarger, B. (1999). Preventing mental disorders in school-age children: A review of the effectiveness of prevention programs. Retrieved June 1, 2004 from www.prevention.psu.edu/pubs/CMHS.html.
12.
Hill, K. G., Howell, J. C., Hawkins, J. D., & Battin-Pearson, S. R. (1999). Childhood risk factors for adolescent gang membership: Results from the Seattle social development project. Journal of Research in Crime and Delinquency, 36, 300-322.
13.
Hill, N. E., Castellino, D. R., Lasford, J. E., Nowlin, P., Dodge, K. A., Bates, J. E., et al. (2004). Parent academic involvement as related to school behavior, achievement, and aspirations: Demographic variations across adolescence. Child Development, 75, 1491-1509.
14.
Holmbeck, G. N., Greenley, R. N., & Franks, G. N. (2004). Developmental issues in evidence-based practice. In P. M. Barrett & T. H. Ollendick (Eds.), Interventions that work with children and adolescents: Prevention and treatment (pp. 27-48). Chichester, England: John Wiley & Sons.
15.
Lagges, A. M., & Gordon, D. A. (1999). Use of an interactive laserdisc parent training program with teenage parents. Child & Family Behavior Therapy, 21, 19-37.
16.
Macgowan, M. J., Nash, J. K., & Fraser, M. W. (2002). The Carolina Child Checklist of risk and protective factors for aggression. Research on Social Work Practice, 12, 253-276.
17.
McDonald, L., Billingham, S., Conrad, T., Morgan A., O, N., & Payton, E. (1997). Families and schools together (FAST): Integrating community development with clinical strategies. Families in Society: The Journal of Contemporary Human Services, 78, 140-155.
18.
McGill, D. E., Mihalic, S. F., & Grotpeter, J. K. (1998). Blueprints for violence prevention, Book Two: Big brothers big sisters of America. Boulder, CO: Center for the Study and Prevention of Violence.
19.
Ollendick, T. H., & King, N. J. (1999). Child behavioral assessment and cognitive-behavioral interventions in schools. Psychology in the Schools, 36, 427-436.
20.
Olweus, D., Limber, S., & Mihalic, S. F. (1999). Blueprints for violence prevention, Book Nine: Bullying prevention program. Boulder, CO: Center for the Study and Prevention of Violence.
21.
Powers, J. D., Bowen, G. L., & Rose, R. A. (in press). Using survey results to identify intervention targets for promoting school success: Links to evidence-based practice. Children & Schools.
22.
Rueter, M. A., Conger, R. D., & Ramisetty-Mikler, S. (1999). Assessing the benefits of a parent skills training program: A theoretical approach to predicting direct and moderating effects. Family Relations, 48, 67-77.
23.
Sameroff, A. J. (2000). Ecological perspectives on developmental risk. In J. D. Osofsky & H. E. Fitzgerald (Eds.), WAIMH handbook of infant mental health: Infant mental health in groups at high risk (Vol. 4, pp. 1-33). New York: John Wiley & Sons.
24.
Silverman, W. K., & Saavedra, L. M. (2004). Assessment and diagnosis in evidence-based practice. In P. M. Barrett & T. H. Ollendick (Eds.), Interventions that work with children and adolescents: Prevention and treatment (pp. 49-69). Chichester, England: John Wiley & Sons.
25.
Statistical Package for the Social Sciences, Inc. (SPSS). (2002). SPSS for Windows (Version 11.5.0). Chicago: Statistical Package for the Social Sciences.
26.
Thyer, B. A. (2002). Principles of evidence-based practice and treatment development. In A. R. Roberts & G. J. Greene (Eds.), Social workers’desk reference (pp. 739-742). New York: Oxford University Press.
27.
Woolley, M. E., Bowen, G. L., & Bowen, N. K. (2004). Cognitive pre-testing and the developmental validity of child self-report instruments: Theory and applications. Research on Social Work Practice, 14, 191-200.
