Past research has shown the effectiveness of contingent acoustic feedback (CAF) in various human performance settings, but its impact on staff performance in clinical settings remains unclear. The current study replicated and extended Herron et al. (2018) by using vocal instructions and CAF to teach staff to use behavior-specific praise (BSP) to reinforce designated client behavior in a clinical setting. Results from a multiple-baseline-across-staff design revealed that this intervention increased the rate at which staff used BSP to reinforce designated client behavior. Paired sample t-tests showed a significant increase in the rate of BSP for each participant from baseline to the intervention phase, and participants maintained increased rates of BSP during probes conducted 1 to 3 weeks after the intervention was complete. Additionally, paired sample t-tests showed statistically significant increases in the rates of designated behavior for each client. Participants also rated the instructions and CAF procedure as more worthwhile, helpful, relevant, pleasant, and less disruptive than feedback methods typically used in their agency.
AlldayR. A.Hinkson-LeeK.HudsonT.Neilsen-GattiS.KleinkeA.RusselC. S. (2012). Training general educators to increase behavior specific praise: Effects on students with EBD. Behavioral Disorders, 37(2), 87–98. https://doi.org/10.1177/019874291203700203
2.
AllisonD. B.SilversteinJ. M.GalanteV. (1993). Relative effectiveness and cost-effectiveness of cooperative, competitive, and independent monetary incentive systems. Journal of Organizational Behavior Management, 13(1), 85–112. https://doi.org/10.1300/J075v13n01_06
3.
AlresheedF.HottB. L.BanoC. (2013). Single subject research: A synthesis of analytic methods. Journal of Special Education Apprenticeship, 2(1), 1–18. https://doi.org/10.58729/2167-3454.1015
4.
ArcoL. (1991). Effects of outcome performance feedback on maintenance of client and staff behavior in a residential setting. Behavioral Interventions, 6(4), 231–247. https://doi.org/10.1002/bin.2360060402
5.
ArcoL. (2008). Feedback for improving staff training and performance in behavioral treatment programs. Behavioral Interventions: Theory & Practice in Residential & Community-Based Clinical Programs, 23(1), 39–64. https://doi.org/10.1002/bin.247
6.
ArcoL.BirnbrauerJ. S. (1990). Performance feedback and maintenance of staff behavior residential settings. Behavioral Interventions, 5(3), 207–217. https://doi.org/10.1002/bin.2360050307
7.
ArnallR.GriffithA. K.KalafutK.SpearJ. (2022). Using vocal consequences with TAGteach™ to teach novel dance movements to adults. Behavioral Interventions, 37(4), 1118–1132. https://doi.org/10.1002/bin.1884
8.
AyllonT.AzrinN. H. (1964). Reinforcement and instructions with mental patients. Journal of the Experimental Analysis of Behavior, 7(4), 327–331. https://doi.org/10.1901/jeab.1964.7-327
9.
BarkerL. K.MooreJ. W.OlmiD. J.RowseyK. (2019). A comparison of immediate and post-session feedback with behavioral skills training to improve interview skills in college students. Journal of Organizational Behavior Management, 39(3–4), 145–163. https://doi.org/10.1080/01608061.2019.1632240
10.
BarlowD. H.NockM. K.HersenM. (2009). Single case experimental designs: Strategies for studying behavior change (3rd ed.). Pearson Education.
11.
BaronA.KaufmanA.StauberK. A. (1969). Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement. Journal of the Experimental Analysis of Behavior, 12(5), 701–712. https://doi.org/10.1901/jeab.1969.12-701
12.
BeckerW. C.MadsenC. H.ArnoldC. R.ThomasD. R. (1967). The contingent use of teacher attention and praise in reducing classroom behavior problems. The Journal of Special Education, 1(3), 287–307. https://doi.org/10.1177/002246696700100307
13.
BelisleJ.RowseyK. E.DixonM. R. (2016). The use of in situ behavioral skills training to improve staff implementation of the PEAK relational training system. Journal of Organizational Behavior Management, 36(1), 71–79. https://doi.org/10.1080/01608061.2016.1152210
14.
BergerS. M.LudwigT. D. (2007). Reducing warehouse employee errors using voice-assisted technology that provided immediate feedback. Journal of Organizational Behavior Management, 27(1), 1–31. https://doi.org/10.1300/J075v27n01_01
15.
BlackmanA. L.DiGennaro ReedF. D.ErathT. G.HenleyA. J. (2023). A survey of staff training and performance management practices: An update. Behavior Analysis in Practice, 16(3), 731–744. https://doi.org/10.1007/s40617-022-00762-0
16.
BreemanS. L.VladescuJ. C.DeBarR. M.GrowL. L.MaranoK. E. (2020). The effects of procedural integrity errors during auditory–visual conditional discrimination training: A preliminary investigation. Behavioral Interventions, 35(2), 203–216. https://doi.org/10.1002/bin.1710
17.
CanonL. F.GouldE. R. (2022). A preliminary analysis of the effects of clicker training and verbal instructions on the acquisition of relationship-building skills in two applied behavior analysis practitioners. Behavior Analysis in Practice, 15(2), 383–396. https://doi.org/10.1007/s40617-021-00555-x.
18.
CarrJ. E. (2005). Recommendations for reporting multiple-baseline designs across participants. Behavioral Interventions: Theory & Practice in Residential & Community-Based Clinical Programs, 20(3), 219–224. https://doi.org/10.1002/bin.191
19.
CarrollR. A.KodakT.FisherW. W. (2013). An evaluation of programmed treatment-integrity errors during discrete-trial instruction. Journal of Applied Behavior Analysis, 46(2), 379–394. https://doi.org/10.1002/jaba.49
20.
ChenL. T.PengC. Y. J.ChenM. E. (2015). Computing tools for implementing standards for single-case designs. Behavior Modification, 39(6), 835–869. https://doi.org/10.1177/0145445515603706
21.
CohenJ. W. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
22.
CoonJ. C.RappJ. T. (2018). Application of multiple baseline designs in behavior analytic research: Evidence for the influence of new guidelines. Behavioral Interventions, 33(2), 160–172. https://doi.org/10.1002/bin.1510
23.
DavisS.ThomsonK.ConnollyM. (2019). A component analysis of behavioral skills training with volunteers teaching motor skills to individuals with developmental disabilities. Behavioral Interventions, 34(4), 431–450. https://doi.org/10.1002/bin.1688
24.
DiGennaro ReedF. D.BlackmanA. L.ErathT. G.BrandD.NovakM. D. (2018). Guidelines for using behavioral skills training to provide teacher support. Teaching Exceptional Children, 50(6), 373–380. https://doi.org/10.1177/0040059918777241
25.
DozierC. L.IwataB. A.Thomason-SassiJ.WorsdellA. S.WilsonD. M. (2012). A comparison of two pairing procedures to establish praise as a reinforcer. Journal of Applied Behavior Analysis, 45(4), 721–735. https://doi.org/10.1901/jaba.2012.45-721
26.
DrakeC. E.WilsonK. G. (2008). Instructional effects on performance in a matching-to-sample study. Journal of the Experimental Analysis of Behavior, 89(3), 333–340. https://doi.org/10.1901/jeab.2008-89-333
27.
DudleyL. L.AxeJ. B.AllenR. F.Sweeney-KerwinE. J. (2019). Establishing praise as a conditioned reinforcer. Pairing with one versus multiple reinforers. Behavior Interventions, 34(4), 534–552. https://doi.org/10.1002/bin.1690
28.
DufreneB. A.LestremauL.Zoder-MartellK. (2014). Direct behavioral consultation: Effects on teachers’ praise and student disruptive behavior. Psychology in the Schools, 51(6), 567–580. doi:10.1002/pits.21768
29.
EckertT. L.HierB. O.HamshoN. F.MalandrinoR. D. (2017). Assessing children’s perceptions of academic interventions: The Kids Intervention Profile. School Psychology Quarterly, 32(2), Article 268. https://doi.org/10.1037/spq0000200
30.
EnnettT. M.ZonneveldK. L.ThomsonK. M.VauseT.DitorD. (2020). Comparison of two TAGteach error-correction procedures to teach beginner yoga poses to adults. Journal of Applied Behavior Analysis, 53(1), 222–236. https://doi.org/10.1002/jaba.550
31.
FisherW. W.PiazzaC. C.BowmanL. G.HagopianL. P.OwensJ. C.SlevinI. (1992). A comparison of two approaches for identifying reinforcers for persons with severe and profound disabilities. Journal of Applied Behavior Analysis, 25(2), 491–498. https://doi.org/10.1901/jaba.1992.25-491
32.
FisherW. W.ZangrilloA. N. (2015). Applied behavior analytic assessment and treatment of autism spectrum disorder. In H. S. Roane, J. E. Ringdahl, & T. S. Falcomata (Eds.), Clinical and organizational applications of applied behavior analysis (pp. 19–45). Elsevier Academic Press. https://doi.org/10.1016/B978-0-12-420249-8.00002-2
33.
FloressM. T.BeschtaS. L.MeyerK. L.ReinkeW. M. (2017). Praise research trends and future directions: Characteristics and teacher training. Behavioral Disorders, 43(1), 227–243. https://doi.org/10.1177/0198742917704648
34.
FogelV. A.WeilT. M.BurrisH. (2010). Evaluating the efficacy of TAGteach as a training strategy for teaching a golf swing. Journal of Behavioral Health and Medicine, 1, 25–41. https://doi.org/10.1037/h0100539
35.
FrylingM. J.WallaceM. D.YassineJ. N. (2012). Impact of treatment integrity on intervention effectiveness. Journal of Applied Behavior Analysis, 45(2), 449–453. https://doi.org/10.1901/jaba.2012.45-449
36.
GalizioM. (1979). Contingency-shaped and rule-governed behavior: Instructional control of human loss avoidance. Journal of the Experimental Analysis of Behavior, 31(1), 53–70. https://doi.org/10.1901/jeab.1979.31-53
37.
GastD. L.LedfordJ. R. (2014). Single case research methodology: Applications in special education and behavioral sciences (2nd ed.). Routledge.
38.
GoldiamondI. (1974). Toward a constructional approach to social problems: Ethical and constitutional issues raised by applied behavior analysis. Behaviorism, 2(1), 1–84. https://doi.org/10.5210/bsi.v11i2.92
39.
GordonS. B.DavidsonN. (1981). Behavioral parent training. In GurmanA. S.KniskernD. P. (Eds.), Handbook of family therapy (Vol. 1, pp.517–555). Brunner/Mazel.
40.
HaffeyN. A.LevantR. F. (1984). The differential effectiveness of two models of skills training for working class parents. Family Relations, 33(2), 209–216. https://doi.org/10.2307/583785
41.
HanleyG. P. (2010). Toward effective and preferred programming: A case for objectively measuring social validity with recipients of behavior-change programs. Behavior Analysis in Practice, 3(1), 13–21. https://doi.org/10.1007/BF03391754
42.
HarrisonA. M.PylesD. A. (2013). The effects of verbal instruction and shaping to improve tackling by high school football players. Journal of Applied Behavior Analysis, 46(2), 518–522. https://doi.org/10.1002/jaba.36
43.
HarteC.Barnes-HolmesD.MoreiraM.de AlmeidaJ. H.PassarelliD.de RoseJ. C. (2021). Exploring a Training IRAP as a single participant context for analyzing reversed derived relations and persistent rule-following. Journal of the Experimental Analysis of Behavior, 115(2), 460–480. https://doi.org/10.1002/jeab.671
44.
HayesS. C.BrownsteinA. J.ZettleR. D.RosenfarbI.KornZ. (1986). Rule-governed behavior and sensitivity to changing consequences of responding. Journal of the Experimental Analysis of Behavior, 45(3), 237–256. https://doi.org/10.1901/jeab.1986.45-237
45.
HayesS. C.WhiteD.BissettR. T. (1998). Protocol analysis and the “silent dog” method of analyzing the impact of self-generated rules. The Analysis of Verbal Behavior, 15(1), 57–63. https://doi.org/10.1007/BF03392923
46.
HerronM. A.LotfizadehA. D.PolingA. (2018). Using conditioned reinforcers to improve behavior-change skills: Clicker training for practitioners. Journal of Organizational Behavior Management, 38(2–3), 172–190. https://doi.org/10.1080/01608061.2018.1454874
47.
HodgesA. C.BetzA. M.WilderD. A.AntiaK. (2019). The use of contingent acoustical feedback to decrease toe walking in a child with autism. Education and Treatment of Children, 42(2), 151–160. https://doi.org/10.1353/etc.2019.0007
48.
HornerR. D.KeilitzI. (1975). Training mentally retarded adolescents to brush their teeth. Journal of Applied Behavior Analysis, 8, 301–309. https://doi.org/10.1901/jaba.1975.8-301
49.
HumeK.SteinbrennerJ. R.OdomS. L.MorinK. L.NowellS. W.TomaszewskiB.SavageM. N. (2021). Evidence-based practices for children, youth, and young adults with autism: Third generation review. Journal of Autism and Developmental Disorders, 51(11), 4013–4032. https://doi.org/10.1007/s10803-020-04844-2
50.
KazdinA. E. (2011). Single-case research design: Methods for clinical and applied settings. Oxford University Press.
51.
KisselR. C.WhitmanT. L.ReidD. H. (1983). An institutional staff training and self- management program for developing multiple self-care skills in severely/profoundly retarded individuals. Journal of Applied Behavior Analysis, 16(4), 395–415. https://doi.org/10.1901/jaba.1983.16-395
52.
LaBrotZ. C.RadleyK. C.DartE.MooreJ.CavellH. J. (2018). A component analysis of behavioral skills training for effective instruction delivery. Journal of Family Psychotherapy, 29(2), 122–141. https://doi.org/10.1080/08975353.2017.1368813
53.
LangbeinJ.SiebertK.NuernbergG.ManteuffelG. (2007). The impact of acoustical secondary reinforcement during shape discrimination learning of dwarf goats (Capra hircus). Applied Animal Behavior Science, 103, 35–44. http://dx.doi.org/10.1016/j.applanim.2006.04.019
54.
LattalK. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93(1), 129–139. https://doi.org/10.1901/jeab.2010.93-129
55.
LechermeierJ.FassnachtM. (2018). How do performance feedback characteristics influence recipients’ reactions? A state-of-the-art review on feedback source, timing, and valence effects. Management Review Quarterly, 68(2), 145–193. https://doi.org/10.1007/s11301-018-0136-8
56.
LevyI. M.FornariE. D.SchulzJ. F.PryorK. W.McKeonT. R.KuhnL. J. (2016). A curriculum for teaching the foundation tool skills to first-year orthopedic surgery residents. Montefiore Journal of Musculoskeletal Medicine & Surgery, 1(1), 4–19. https://doi.org/10.12678/2470-3680.1.1.4
57.
LovaasO. I.FreitagG.KinderM. I.RubensteinB. D.SchaefferB.SimmonsJ. Q. (1966). Establishment of social reinforcers in two schizophrenic children on the basis of food. Journal of Experimental Child Psychology, 4(2), 109–125. https://doi.org/10.1016/0022-0965(66)90011-7
58.
MagginD. M.BrieschA. M.ChafouleasS. M. (2013). An application of the What Works Clearinghouse standards for evaluating single-subject research: Synthesis of the self- management literature base. Remedial and Special Education, 34(1), 44–58. https://doi.org/10.1177/0741932511435176
59.
MangiapanelloK. A.HemmesN. S. (2015). An analysis of feedback from a behavior analytic perspective. The Behavior Analyst, 38(1), 51–75. https://doi.org/10.1007/s40614-014-0026-x
60.
McCallC. A.BurginS. E. (2002). Equine utilization of secondary reinforcement during response extinction and acquisition. Applied Animal Behaviour Science, 78, 253–262.
61.
MoffatT. K. (2011). Increasing the teacher rate of behaviour specific praise and its effect on a child with aggressive behaviour problems. Kairaranga, 12(1), 51–58.
62.
MrachkoA. A.KostewiczD. E.MartinW. P. (2017). Increasing positive and decreasing negative teacher responses to student behavior through training and feedback. Behavior Analysis: Research and Practice, 17(3), Article 250. https://doi.org/10.1037/bar0000082
63.
O’HoraD.Barnes-HolmesD.StewartI. (2014). Antecedent and consequential control of derived instruction-following. Journal of the Experimental Analysis of Behavior, 102(1), 66–85. https://doi.org/10.1002/jeab.95
64.
ParsonsM. B.RollysonJ. H.ReidD. H. (2012). Evidence-based staff training: A guide for practitioners. Behavior Analysis in Practice, 5, 2–11. https://doi.org/10.1007/BF03391819
65.
PersickeA.JacksonM.AdamsA. N. (2014). Brief report: An evaluation of TAGteach components to decrease toe-walking in a 4-year-old child with autism. Journal of Autism and Developmental Disorders, 44, 965–968. https://doi.org/10.1007/s10803-013-1934-4
66.
PipkinC. S. P.VollmerT. R.SlomanK. N. (2010). Effects of treatment integrity failures during differential reinforcement of alternative behavior: A translational model. Journal of Applied Behavior Analysis, 43(1), 47–70. https://doi.org/10.1901/jaba.2010.43-47
67.
PryorK. W. (1984). Don’t shoot the dog! The new art of teaching and training. Bantam Books.
68.
PryorK. W. (2009). Reaching the animal mind. Scribner.
69.
PryorK. W.HaagR.ReillyJ. (1969). The creative porpoise: Training for novel behavior. Journal of the Experimental Analysis of Behavior, 12(4), 653–661. https://doi.org/10.1901/jeab.1969.12-653
70.
PryorK. W.RamirezK. (2014). Modern animal training. In McSweeneyF. K.MurphyE. S. (Eds.), The Wiley Blackwell handbook of operant and classical conditioning (pp. 453–482) Chichester: Blackwell. https://doi.org/10.1002/9781118468135.ch18
71.
QuinnM. J.MiltenbergerR. G.FogelV. A. (2015). Using TAGteach to improve the proficiency of dance movements. Journal of Applied Behavior Analysis, 48(1), 11–24. https://doi.org/10.1002/jaba.191
72.
ReinkeW. M.Lewis-PalmerT.MartinE. (2007). The effect of visual performance feedback on teacher use of behavior-specific praise. Behavior Modification, 31(3), 247–263. https://doi.org/10.1177/0145445506288967
73.
ReinkeW. M.Lewis-PalmerT.MerrellK. (2008). The classroom check-up: A classwide teacher consultation model for increasing praise and decreasing disruptive behavior. School Psychology Review, 37(3), 315–332.
74.
ReppA. C.DietzD. E. D.BolesS. M.DietzS. M.ReppC. F. (1976). Differences among common methods for calculating interobserver agreement. Journal of Applied Behavior Analysis, 9, 109–113. https://doi.org/10.1901/jaba.1976.9-109
75.
RitzwollerD. P.SukhanovaA.GaglioB.GlasgowR. E. (2009). Costing behavioral interventions: A practical guide to enhance translation. Annals of Behavioral Medicine, 37(2), 218–227. https://doi.org/10.1007/s12160-009-9088-5
76.
Rosales-RuizJ. (2023). Lessons from Og: How to teach a rat to lift weights and why you shouldn’t try to milk a chicken. In CalkinA. B. (Ed.), Tribute to Ogden Lindsey: His life and contributions (pp. 179–194). Sloan Publishing.
77.
ScottD.ScottL. M.GoldwaterB. (1997). A performance improvement program for an international-level track and field athlete. Journal of Applied Behavior Analysis, 30(3), 573–575. https://doi.org/10.1901/jaba.1997.30-573.
78.
ScruggsT. E.MastropieriM. A.CastoG. (1987). The quantitative synthesis of single- subject research: Methodology and validation. Remedial and Special Education, 8(2), 24–33. https://doi.org/10.1177/0741932587008002
79.
ShapiroM.KazemiE. (2017). A review of training strategies to teach individuals implementation of behavioral interventions. Journal of Organizational Behavior Management, 37(1), 32–62. https://doi.org/10.1080/01608061.2016.1267066
80.
SidmanM. (1960). Tactics of scientific research. Basic Books.
81.
SimmonsC. A.MartinezS. E.FordK. R.FisherW. W.ZangrilloA. N. (2021). Identification of alternative instructional methods when physical guidance is contraindicated. Behavioral Development, 26(2), Article 81. https://doi.org/10.1037/bdb0000103
82.
SimonsenB.FreemanJ.DooleyK.MaddockE.KernL.MyersD. (2017). Effects of targeted professional development on teachers’ specific praise rates. Journal of Positive Behavior Interventions, 19(1), 37–47. https://doi.org/10.1177/1098300716637192
83.
SolmiM.SongM.YonD. K.LeeS. W.FombonneE.KimM. S.ParkS.LeeM. H.HwangJ.KellerR.CorteseS. (2022). Incidence, prevalence, and global burden of autism spectrum disorder from 1990 to 2019 across 204 countries. Molecular Psychiatry, 27(10), 4172–4180. https://doi.org/10.1038/s41380-022-01630-7
84.
SteinbrennerJ. R.HumeK.OdomS. L.MorinK. L.NowellS. W.TomaszewskiB.SzendreyS.McIntyreN. S.Yücesoy-ÖzkanS.SavageM. N. (2020). Evidence-based practices for children, youth, and young adults with autism. The University of North Carolina, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team. https://ncaep.fpg.unc.edu/sites/ncaep.fpg.unc.edu/files/imce/documents/EBP%20Report%202020.pdf
85.
StokesJ. V.LuiselliJ. K.ReedD. D.FlemingR. K. (2010). Behavioral coaching to improve offensive line pass-blocking skills of high school football athletes. Journal of Applied Behavior Analysis, 43(3), 463–472. https://doi.org/10.1901/jaba.2010.43-463.
86.
SutherlandK. S.WehbyJ. H.CopelandS. R. (2000). Effect of varying rates of behavior- specific praise on the on-task behavior of students with EBD. Journal of Emotional and Behavioral Disorders, 8(1), 2–8. https://doi.org/10.1177/106342660000800101
87.
TestD. W.SpoonerF.KeulP. K.GrossiT. (1990). Teaching adolescents with severe disabilities to use the public telephone. Behavior Modification, 14(2), 157–171. https://doi.org/10.1177/01454455900142003
88.
WagnerT. H.GoldsteinM. K. (2004). Behavioral interventions and cost-effectiveness analysis. Preventive Medicine, 39(6), 1208–1214. https://doi.org/10.1016/j.ypmed.2004.04.052
89.
Ward-HornerJ.SturmeyP. (2012). Component analysis of behavior skills training in functional analysis. Behavioral Interventions, 27(2), 75–92. https://doi.org/10.1002/bin.1339
WendtO. (2007, November). Meta-analysis of single-subject experimental designs [Paper presentation].The panel “roles of single-subject experimental designs in EBP Times” at the Annual Convention of the American Speech-Language-Hearing Association (ASHA), Boston, MA, United States.
92.
VorbeckB.BördleinC. (2020). Using auditory feedback in body weight training. Journal of Applied Behavior Analysis, 53(4), 2349–2359. https://doi.org/10.1002/jaba.723
93.
YooK.WuX.ZhuangW.XiaZ.LiuY. (2020). The effects of audible feedback as a coaching strategy on golf skill learning for novice players. International Journal of Performance Analysis in Sport, 20(4), 596–609. https://doi.org/10.1080/24748668.2020.1765525
94.
ZettleR. D.YoungM. J. (1987). Rule-following and human operant responding: Conceptual and methodological considerations. The Analysis of Verbal Behavior, 5(1), 33–39. https://doi.org/10.1007/BF03392818
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
