The BUDL Effect: Examining Academic Achievement and Engagement Outcomes of Preadolescent Baltimore Urban Debate League Participants

Abstract

This study adds to the limited literature base on extracurricular debate by using doubly robust inverse probability treatment weighting to estimate the average treatment effect for the treated of preadolescent debate participation on a variety of academic and engagement outcomes among a 10-year longitudinal sample of Baltimore City Public School System students. The effect of preadolescent Baltimore Urban Debate League participation for debaters was associated with increases in standardized test scores, a decreased likelihood of chronic absenteeism, and an increased likelihood of attending a selective entrance criteria high school. Although there is a mounting body of research that suggests participation in debate is associated with increases in positive outcomes for high school students, this research constitutes the first quantitative study to examine these relationships among elementary and middle school students. Policy implications for educational interventions that seek to attract low-income students of color in urban areas and influence their trajectories at earlier stages of student development are discussed.

Keywords

achievement adolescence policy analysis program evaluation quasi-experimental analysis regression analyses urban education

Get full access to this article

View all access options for this article.

References

Abbott

R. D.

O’Donnell

Hawkins

J. D.

Hill

K. G.

Kosterman

Catalano

R. F.

(1999). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68(4), 542–552.

Anderson

Mezuk

(2015). Positive youth development and participation in an urban debate league: Results from Chicago public schools, 1997-2007. Journal of Negro Education, 84(3), 362.

Balfanz

Byrnes

(2012). The importance of being in school: A report on absenteeism in the nation’s public schools. Baltimore: Johns Hopkins University Center for Social Organization of Schools.

Balfanz

Herzog

Mac Iver

D. J.

(2007). Preventing student disengagement and keeping students on the graduation path in urban middle-grades schools: Early identification and effective interventions. Educational Psychologist, 42(4), 223–235.

Breger

(2000). Overview of the urban debate program. Rostrum, 75(14).

Broh

B. A.

(2002). Linking extracurricular programming to academic achievement: Who benefits and why? Sociology of Education, 75(1), 69.

Chang

H. N.

Bauer

Byrnes

(2018, September). Data matters: Using chronic absence to accelerate action for student success. n.p.: Attendance Works and Everyone Graduates Center.

Coleman

J. S.

(1959). Academic achievement and the structure of competition. Harvard Educational Review, 29, 330–351.

Coleman

J. S.

(1961). The adolescent society. New York: Free Press of Glencoe.

10.

Crispin

L. M.

(2017). Extracurricular participation, “at-risk” status, and the high school dropout decision. Education Finance and Policy, 12(2), 166–196.

11.

Denault

A. S.

Poulin

(2009). Intensity and breadth of participation in organized activities during the adolescent years: Multiple associations with youth outcomes. Journal of Youth and Adolescence, 38, 1199–1213. doi:10.1007/s10964-009-9437-5

12.

Durham

R. E.

Stein

Connolly

(2015). College opportunities and success: Baltimore City graduates through the class of 2014. Baltimore: Baltimore Education Research Consortium.

13.

Eccles

J. S.

Barber

B. L.

(1999). Student council, volunteering, basketball, or marching band what kind of extracurricular involvement matters? Journal of Adolescent Research, 14, 10–43. doi:10.1177/0743558499141003

14.

Entwisle

D. R.

Alexander

K. L.

(1992). Summer setback: Race, poverty, school composition, and mathematics achievement in the first two years of school. American Sociological Review, 57 (1), 72-84.

15.

Feldman

Matjasko

J. L.

(2005). The role of school-based extracurricular activities in adolescent development: A comprehensive review and future directions. Review of Educational Research, 75, 159–210.

16.

Fine

G. A.

(2001). Gifted tongues: High school debate and adolescent culture. Princeton, NJ: Princeton University Press.

17.

Fredricks

Simpkins

(2012). Promoting positive youth development through organized after-school activities: Taking a closer look at participation of ethnic minority youth. Child Development Perspectives, 6(3), 280–287. doi:10.1111/j.1750- 8606.2011.00206.x

18.

Gibbs

B. G.

Erickson

L. D.

Dufur

M. J.

Miles

(2015). Extracurricular associations and college enrollment. Social Science Research, 50, 367–381.

19.

Gottfredson

D. C.

Cross

Soulé

D. A.

(2007). Distinguishing characteristics of effective and ineffective after-school programs to prevent delinquency and victimization. Criminology & Public Policy, 6(2), 289–318.

20.

Heckman

J. J.

(2006). Skill formation and the economics of investing in disadvantaged children. Science, 312, 1900–1902.

21.

Johnson

D. W.

Johnson

R. T.

Stanne

M. B.

(2000). Cooperative learning methods: A meta-analysis. Retrieved from https://pdfs.semanticscholar.org/93e9/97fd0e883cf7cceb3b1b612096c27aa40f90.pdf

22.

Johnson

D. W.

Maruyama

Johnson

Nelson

Skon

(1981). Effects of cooperative, competitive, and individualistic goal structures on achievement: A meta-analysis. Psychological Bulletin, 89, 47–62.

23.

Kena

Hussar

McFarland

de Brey

Musu-Gillete

Wang

Dunlop Velez

(2016). The condition of education 2016 (NCES 2016-144). Washington, DC: U.S. Department of Education, National Center for Education Statistics.

24.

Kieffer

M. J.

Marinell

W. H.

(2012). Navigating the middle grade: Evidence from New York City. New York: The Research Alliance for New York City Schools.

25.

Lipscomb

(2007). Secondary school extracurricular involvement and academic achievement: A fixed effect approach. Economics of Education Review, 26(4), 463–472.

26.

Mac Iver

M. A

. (2010). Gradual disengagement: A portrait of the 2008-2009 dropouts in the Baltimore City Schools. A Research Report by the Baltimore Education Research Consortium, Baltimore, MD.

27.

Mahoney

J. L.

Cairns

B. D.

Farmer

T. W.

(2003). Promoting interpersonal competence and educational success through extracurricular activity participation. Journal of Educational Psychology, 95, 409–418.

28.

McNeal

R. B.

(1995). Extracurricular activities and high-school dropouts. Sociology of Education, 68(1), 62–80.

29.

Mezuk

(2009). Urban debate and high school educational outcomes for African American males: The case of the Chicago Debate League. Journal of Negro Education, 78, 290–304.

30.

Mezuk

Bondarenko

Smith

Tucker

(2011). Impact of participating in a policy debate program on academic achievement: Evidence from the Chicago Urban Debate League. Educational Research and Reviews, 6, 622–635.

31.

Mitchell

(1998). Pedagogical possibilities for argumentative agency in academic debate. Argumentation Advocacy, 35, 41–56.

32.

Morgan

S. L.

Todd

J. J.

(2008). A diagnostic routine for the detection of consequential heterogeneity of causal effects. Sociological Methodology, 38, 231–281.

33.

Morgan

S. L.

Winship

(2015). Counterfactuals and causal inference: Methods and principles for social research. Cambridge, UK: Cambridge University Press.

34.

National Association of Urban Debate Leagues. (2016). Our results. Retrieved from http://urbandebate.org/Our-Results

35.

National Governors Association. (2010). The common core state standards. Retrieved from http://www.corestandards.org/the-standards.

36.

National Institute on Out-of-School Time. (2003). Fact sheet on school-age children’s out of school time. Wellesley, MA: Wellesley College, Center for Research on Women.

37.

Pedersen

(2005). Urban adolescents’ out-of-school activity profiles: Associations with youth, family, and school transition characteristics. Applied Developmental Science, 9(2), 107–127. doi:10.1207/s1532480xads0902

38.

Porter

McMaken

Hwang

Yang

(2011). Common core standards: The new U.S. intended curriculum. Educational Researcher, 40, 103–116.

39.

Quinn

(1999). Where need meets opportunity: Youth development programs for early teens. The Future of Children, 9(2), 96–116. Retrieved from http://www.jstor.org/stable/10.2307/1602709

40.

Robins

J. M.

Rotnitzky

(2001). Comment on the Bickel and Kwon article, “Inference for semiparametric models: Some questions and an answer.” Statistica Sinica, 11, 920–936.

41.

Rosenbaum

P. R.

Rubin

D. B.

(1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.

42.

Rubin

D. B.

(1973). Matching to remove bias in observational studies. Biometrics, 29, 159–183.

43.

Schwartz

Cappella

Seidman

(2015). Extracurricular participation and course performance in the middle grades: A study of low-income, urban youth. American Journal of Community Psychology, 56, 307–320.

44.

Shackelford

D. T.

Ratliff

Mezuk

(2018). Participating in a high school debate program and college matriculation and completion: Evidence from the Chicago Debate League. Manuscript submitted for publication.

45.

Shulruf

(2010). Do extracurricular activities in schools improve educational outcomes? A critical review and meta-analysis of the literature. International Review of Education, 56(5), 591.

46.

Slavin

R. E.

(1980). Cooperative learning. Review of Educational Research, 50(2), 315–342.

47.

Slavin

R. E.

(1983). When does cooperative learning increase student achievement? Psychological Bulletin, 94, 429–445.

48.

Snipes

Horowitz

(2008). Advancing adolescent literacy in urban schools. Washington, DC: Council of the Great City Schools.

49.

Stevenson

(2010). Beyond the classroom: Using Title IX to measure the return to high school sports. Review of Economics and Statistics, 92(2), 284–301.

50.

Swanson

C. B.

(2009, April). Cities in Crisis 2009: Closing the graduation gap - educational and economic conditions in America’s largest cities. Bethesda, MD: Editorial Projects in Education Research Center.

51.

U.S. Census Bureau. (2014). A child’s day: Living arrangements, nativity, and family transitions: 2011. Washington, DC: U.S. Department of Commerce Economics and Statistics Administration. Retrieved from https://www.census.gov/newsroom/press-releases/2014/cb14-224.html

52.

Winkler

(2011). To argue or to fight: Improving at-risk students’ school conduct through urban debate. Controversia, 7(2), 76–90.