This study aimed to evaluate the effectiveness of customized chatbots in enhancing counseling self-efficacy among social work students and to examine whether perceived ease of use influences this development.
Method
A total of 41 participants engaged in simulated counseling practices using six role-play chatbots created on the Poe platform, each representing diverse client profiles and backgrounds.
Results
The findings showed statistically significant improvements in overall counseling self-efficacy scores from pretest to posttest and perceived ease of use was a strong predictor of counseling self-efficacy.
Discussion
The results of this study demonstrate that chatbot-based role-play can effectively enhance counseling self-efficacy, providing valuable insights for future chatbot design in counselor training. Since ease of use strongly influenced learning outcomes, future chatbots should be simple to navigate and engaging to encourage consistent practice. Creating realistic characters with diverse backgrounds helps simulate real counseling situations.
AliyevR.TuncE. (2015). Self-efficacy in counseling: The role of organizational psychological capital, job satisfaction, and burnout. Procedia—Social and Behavioral Sciences, 190, 97–105. https://doi.org/10.1016/j.sbspro.2015.04.922
2.
BrockerA.ScafideK. N. (2023). Systematic review: Self-efficacy and skill performance. International Nursing Review, 71(4), 810–822. https://doi.org/10.1111/inr.12915
3.
CarterJ. W.ScottJ. T.BarrettJ. D. (2025). The emotional cost of AI chatbots in education: Who benefits and who struggles?Computers in Human Behavior: Artificial Humans, 5, 100181. https://doi.org/10.1016/j.chbah.2025.100181
4.
ChanC.LiF. (2023). Developing a natural language-based AI-chatbot for social work training: An illustrative case study. China Journal of Social Work, 16(2), 121–136. https://doi.org/10.1080/17525098.2023.2176901
5.
ChangC.HwangG.GauM. (2021). Promoting students’ learning achievement and self-efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53(1), 171–188. https://doi.org/10.1111/bjet.13158
ClarkeP. B.BinkleyE. E.AndrewsS. M. (2017). Actors in the classroom: The dramatic pedagogy model of counselor education. Journal of Creativity in Mental Health, 12(1), 129–145. https://doi.org/10.1080/15401383.2016.1196156
8.
DavisF. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319. https://doi.org/10.2307/249008
9.
DengX.YuZ. (2023). A meta-analysis and systematic review of the effect of chatbot technology use in sustainable education. Sustainability, 15(4), 2940. https://doi.org/10.3390/su15042940
10.
KleineA.SchaffernakI.LermerE. (2025). Exploring predictors of AI chatbot usage intensity among students: Within- and between-person relationships based on the technology acceptance model. Computers in Human Behavior: Artificial Humans, 3, 100113. https://doi.org/10.1016/j.chbah.2024.100113
11.
KnowlesM. S. (1984). Andragogy in action: Applying principles of adult learning. Jossey-Bass.
12.
KolbD. A. (1984). Experiential learning: Experience as the source of learning and development. Prentice Hall.
13.
KourgiantakisT.BogoM.SewellK. M. (2019). Practice Fridays: Using simulation to develop holistic competence. Journal of Social Work Education, 55, 551–564. https://doi.org/10.1080/10437797.2018.1548989
LarsonL. M.DanielsJ. A. (1998). Review of the counseling self-efficacy literature. The Counseling Psychologist, 26(2), 179–218. https://doi.org/10.1177/0011000098262001
16.
LarsonL. M.SuzukiL. A. (1992). Development and validation of the counseling self-estimate inventory. Journal of Counseling Psychology, Washington, 39(1), 105–115.
17.
LarsonL. M.SuzukiL. A.GillespieK. N.PotenzaM. T.BechtelM. A.ToulouseA. L. (1992). Development and validation of the Counseling Self-Estimate Inventory. Journal of Counseling Psychology, 39(1), 105–120. https://doi.org/10.1037//0022-0167.39.1.105
18.
MathurS.LopezD. (2018). A scaled-down neural conversational model for chatbots. Concurrency and Computation: Practice and Experience, 31(10). https://doi.org/10.1002/cpe.4761
19.
MauryaR. K. (2023). Using AI based chatbot ChatGPT for practicing counseling skills through role-play. Journal of Creativity in Mental Health, 19(4), 513–528. https://doi.org/10.1080/15401383.2023.2297857
20.
MemarianB.DoleckT. (2023). ChatGPT in education: Methods, potentials, and limitations. Computers in Human Behavior: Artificial Humans, 1(2), 100022. https://doi.org/10.1016/j.chbah.2023.100022
21.
McGovernM. (2024). Using the generative artificial intelligence (AI) chatbots of perplexity and ChatGPT as a teaching and learning tool for practice teachers and students within social work placement. The Journal of Practice Teaching and Learning, 22(1–2), 38–56. https://doi.org/10.1921/jpts.v21i3.2223
22.
NikendeiC.HuberJ.EhrenthalJ. C.HerzogW.SchauenburgH.SchultzJ.DingerU. (2019). Intervention training using peer role-play and standardised patients in psychodynamic psychotherapy trainees. Counselling and Psychotherapy Research, 19(4), 508–522. https://doi.org/10.1002/capr.12232
23.
OsterC.LeibbrandtR.SchooA.LangeB.LittJ.MorelloA.AntonelloC.PowersD.MaederA.LawnS. (2022). A feasibility study of teaching motivational interviewing in a fully online environment using a virtual client. International Journal of Health Promotion and Education, 63(4), 193–204. https://doi.org/10.1080/14635240.2022.2047095
24.
RäuchleJ.KühneF.ZachariasA.GroßeG.WeckF.MaaßU. (2025). Insights from roleplays with standardised patients and live supervision for psychotherapy and counselling training—A qualitative study. Counselling and Psychotherapy Research, 25(2). https://doi.org/10.1002/capr.70018
25.
ShevatA. (2017). Designing bots: Creating conversational experiences. O'Reilly Media, Inc.
26.
TananaM. J.SomaC. S.SrikumarV.AtkinsD. C.ImelZ. E. (2019). Development and evaluation of ClientBot: Patient-like conversational agent to train basic counseling skills. Journal of Medical Internet Research, 21(7), e12529. https://doi.org/10.2196/12529
27.
TuffordL.AsakuraK.BogoM. (2018). Simulation versus role-play: Perceptions of prepracticum BSW students. Journal of Baccalaureate Social Work, 23, 249–267. https://doi.org/10.18084/1084-7219.23.1.249
28.
ÜmmetD. (2017). Structural relationships among counselling self-efficacy, general self-efficacy and positive–negative affect in psychological counsellor candidates. Kuram ve Uygulamada Egitim Bilimleri, 17(6), 1875–1892. https://doi.org/10.12738/estp.2017.6.0180
29.
VanichvasinP. (2021). Chatbot development as a digital learning tool to increase students’ research knowledge. International Education Studies, 14(2), 44–53. https://doi.org/10.5539/ies.v14n2p44
30.
WangW.ChenX.MiaoD.ZhangH.QinX.GuX.LuP. (2025). Optimizing chatbot responsiveness: Automated history context selector via three-way decision for multi-turn dialogue large language models. Engineering Analysis with Boundary Elements, 173, 106150. https://doi.org/10.1016/j.enganabound.2025.106150
