Evaluating the Relationship Between Performance on a Multiple-Choice Examination and Common ABA-Based Procedures

Abstract

To ensure the quality of training, skills developed and maintained, and expected standards for behavior analysts, several systems have been put into place across the years. Of these systems, perhaps the most widespread was the development of the Behavior Analyst Certification Board in 1998. Once all requirements are met, the final determinative step in obtaining certification is a multiple-choice examination. The use of a multiple-choice examination as the final determinative step in obtaining behavior analytic certification may create some concerns for behavior analysts. Identification of a positive correlation between the multiple-choice examination and performance may help ameliorate these concerns. The purpose of this study was to evaluate any potential correlations between scores on a popular commercially available prep examination and basic applied behavior analysis (ABA)–based autism intervention procedures with 25 professionals. Overall, the results indicated that multiple-choice examination scores were not significantly correlated with any assessments of performance.

Keywords

certification staff assessment staff training training

Get full access to this article

View all access options for this article.

References

Ala’i-Rosales

Zeug

(2010). Three important things to consider when starting intervention for a child diagnosed with autism. Behavior Analysis in Practice, 3(2), 54–55. https://doi.org/10.1007/BF03391766

Baer

D. M.

Wolf

M. M.

Risley

T. R.

(1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), 91–97.

Behavior Analyst Certification Board. (2021). Board certified behavior analyst handbook. https://www.bacb.com/wp-content/uploads/2020/11/BCBAHandbook_210212.pdf

Behavior Analyst Certification Board. (n.d.). BACB certificant data. https://www.bacb.com/BACB-certificant-data

Behavior Development Solutions. (n.d.). BCBA/BCaBA products. https://www.behaviordevelopmentsolutions.com/bcba-exam-prep

Bibby

Eikeseth

Martin

N. T.

Mudford

O. C.

Reeves

(2001). Progress and outcomes for children with autism receiving parent-managed intensive interventions. Research in Developmental Disabilities, 22(6), 425–447. https://doi.org/10.1016/s0891-4222(01)00082-8

Carr

J. E.

Nosik

M. R.

DeLeon

I. G.

(2017). The Registered Behavior Technician™ credential: A response to Leaf et al. (2017). Behavior Analysis in Practice, 10(2), 164–166. https://doi.org/10.1007/s40617-017-0172-1

Cohen

(1988). Statistical power analysis for the behavioral sciences (Vol. 2). Lawrence Erlbaum.

Conover

W. J.

Iman

R. L.

(1981). Rank transformations as a bridge between parametric and nonparametric statistics. The American Statistician, 35(3), 124–129. https://doi.org/10.2307/2683975

10.

Leaf

J. B.

Aljohani

W. A.

Milne

C. M.

Ferguson

J. L.

Cihon

J. H.

Oppenheim-Leaf

M. L.

McEachin

Leaf

(2019). Training behavior change agents and parents to implement discrete trial teaching: A literature review. Review Journal of Autism and Developmental Disorders, 6(1), 26–39. https://doi.org/10.1007/s40489-018-0152-6

11.

Leaf

J. B.

Leaf

McEachin

Bondy

Cihon

J. H.

Detrich

Eshleman

Ferguson

J. L.

Foxx

R. M.

Freeman

B. J.

Gerhardt

Glenn

S. S.

Miller

Milne

C. M.

Mountjoy

Parker

Pritchard

Ross

R. K.

Saunders

M. S.

Streff

(2020). The importance of professional discourse for the continual advancement of practice standards: The RBT® as a case in point. Journal of Autism and Developmental Disorders, 51, 1789–1801. https://doi.org/10.1007/s10803-020-04631-z

12.

Leaf

J. B.

Leaf

McEachin

Taubman

Smith

Harris

S. L.

Freeman

B. J.

Mountjoy

Parker

Streff

Volkmar

F. R.

Waks

(2017). Concerns about the Registered Behavior Technician™ in relation to effective autism intervention. Behavior Analysis in Practice, 10(2), 154–163. https://doi.org/10.1007/s40617-016-0145-9

13.

Lerman

D. C.

Valentino

A. L.

LeBlanc

L. A.

(2016). Discrete trial training. In Lang

Hancock

T. B.

Singh

N. N.

(Eds.), Early intervention for young children with autism spectrum disorder (pp. 47–83). Springer. https://doi.org/10.1007/978-3-319-30925-5_3

14.

Lord

Rutter

DiLavore

P. C.

Risi

(1999). Autism diagnostic observation schedule-WPS. Western Psychological Services.

15.

Moore

Shook

G. L.

(2001). Certification, accreditation, and quality control in behavior analysis. The Behavior Analyst, 24(1), 45–55. https://doi.org/10.1007/BF03392018

16.

Porto

R. B.

Oliveira-Castro

J. M.

(2013). Say-do correspondence in brand choice: Interaction effects of past and current contingencies. The Psychological Record, 63(2), 345–362. https://doi.org/10.11133/j.tpr.2013.63.2.009

17.

Risley

T. R.

(1975). Certify procedures not people. In Scott Wood

(Ed.), Issues in evaluating behavior modification (pp. 159–181). Research Press.

18.

Shook

G. L.

(2005). An examination of the integrity and future of the Behavior Analyst Certification Board credentials. Behavior Modification, 29(3), 562–574. https://doi.org/10.1177/0145445504274203

19.

Shook

G. L.

Ala’i-Rosales

Glenn

S. S.

(2002). Training and certifying behavior analysts. Behavior Modification, 26(1), 27–48. https://doi.org/10.1177/0145445502026001003

20.

Starin

Hemingway

Hartsfield

(1993). Credentialing behavior analysts and the Florida behavior analysis certification program. The Behavior Analyst Today, 16(2), 153–166. https://doi.org/10.1007/BF03392620

21.

Weiss

M. J.

Shook

G. L.

(2010). Resources on training requirements for applied behavior analysts: The Behavior Analyst Certification Board and the autism special interest group consumer guidelines. European Journal of Behavior Analysis, 11(2), 217–222. https://doi.org/10.1080/15021149.2010.11434345

22.

Wolf

M. M.

(1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11(2), 203–214. https://doi.org/10.1901/jaba.1978.11-203