Reinforcement learning (RL) has significant potential across various fields, with its application in sports decision optimization emerging as a prominent research focus amid rapid advances in AI technologies. This paper develops tennisDecisionRL, an RL-driven decision optimization framework for tennis competitions that captures critical match dynamics through the integration of RL techniques such as Deep Q-Networks (DQN) and Proximal Policy Optimization (PPO). The proposed system enhances the sophistication and adaptability of competitive decision-making processes. Empirical evaluations using two datasets demonstrate its superior performance compared to traditional approaches. The paper concludes by identifying current limitations and outlining future research directions, providing novel insights for decision optimization in tennis and other athletic competitions.
KolmanNSKramerTElferink-GemserMT, et al.Technical and tactical skills related to performance levels in tennis: a systematic review. J Sports Sci2019; 37: 108–121.
2.
LiZYuD. A Spatiotemporal Graph Transformer Network for real-time ball trajectory monitoring and prediction in dynamic sports environments. Alex Eng J2025; 119: 246–258.
3.
ShahMShahAPatelK, et al.Predictive analytics, strategic game analysis, and injury prevention in sports: the role of big data and artificial intelligence. Mach Learn Comput Sci Eng2025; 1: 1–25.
4.
WangLZhouZZouQ. Analysis system for table tennis techniques and tactics using data mining. Soft Comput2023; 27: 14269–14284.
5.
YuQ. Performance assessment and fitness analysis of athletes using decision tree and data mining techniques. Soft Comput2024; 28: 1055–1072.
6.
WilsonAAnwarMR. The future of adaptive machine learning algorithms in high-dimensional data processing. Int Trans Artif Intell2024; 3: 97–107.
7.
ReisSReisLPLauN. Game adaptation by using reinforcement learning over meta games. Group Decis Negot2021; 30: 321–340.
8.
MortazaviFMoradiHVahabieA-H. Dynamic difficulty adjustment approaches in video games: a systematic literature review. Multimed Tool Appl2024; 83: 83227–83274.
9.
PisanielloA. The game changer: how artificial intelligence is transforming sports performance and strategy. Geopolit Soc Secur Freedom J2024; 7: 75–84.
FengZ-kNiuW-jChengC-t, et al.Optimization of large-scale hydropower system peak operation with hybrid dynamic programming and domain knowledge. J Clean Prod2018; 171: 390–402.
12.
LiuDXueSZhaoB, et al.Adaptive dynamic programming for control: a survey and recent advances. IEEE Trans Syst Man Cybern Syst2020; 51: 142–160.
13.
BrandãoBDe LimaTWSoaresA, et al.Multiagent reinforcement learning for strategic decision making and control in robotic soccer through self-play. IEEE Access2022; 10: 72628–72642.
14.
ZhengYHaoQWangJ, et al.A survey of machine learning for urban decision making: applications in planning, transportation, and healthcare. ACM Comput Surv2024; 57: 1–41.
15.
NguyenTTNguyenNDNahavandiS. Deep reinforcement learning for multiagent systems: a review of challenges, solutions, and applications. IEEE Trans Cybern2020; 50: 3826–3839.
16.
QiaoHChenJHuangX. A survey of brain-inspired intelligent robots: integration of vision, decision, motion control, and musculoskeletal systems. IEEE Trans Cybern2021; 52: 11267–11280.
17.
UeharaMKiyoharaHBennettA, et al.Future-dependent value-based off-policy evaluation in pomdps. Adv Neural Inf Process Syst2023; 36: 15991–16008.
18.
DubeyGPStalinSAlqahtaniO, et al.Optimal path selection using reinforcement learning based ant colony optimization algorithm in IoT-Based wireless sensor networks with 5G technology. Comput Commun2023; 212: 377–389.
19.
DullenSVermaDBlackburnM, et al.Survey on set-based design (SBD) quantitative methods. Syst Eng2021; 24: 269–292.
20.
JangBKimMHarerimanaG, et al.Q-learning algorithms: a comprehensive classification and applications. IEEE Access2019; 7: 133653–133667.
21.
ShaXWeiGZhangX, et al.Accurate recognition of player identity and stroke performance in table tennis using a smart wristband. IEEE Sens J2021; 21: 10923–10932.
22.
WülfingJMKumarSSBoedeckerJ, et al.Adaptive long-term control of biological neural networks with deep reinforcement learning. Neurocomputing2019; 342: 66–74.
23.
HeJTangMHuC, et al.Deep reinforcement learning for generalizable field development optimization. SPE J (Soc Pet Eng (U S), 1996)2022; 27: 226–245.
24.
OagazHSchounBChoiM-H. Performance improvement and skill transfer in table tennis through training in virtual reality. IEEE Trans Vis Comput Graph2021; 28: 4332–4343.
25.
JainGKumarABhatSA. Recent developments of game theory and reinforcement learning approaches: a systematic review. IEEE Access2024; 12: 9999–10011.
26.
GeHSongYWuC, et al.Cooperative deep Q-learning with Q-value transfer for multi-intersection signal control. IEEE Access2019; 7: 40797–40809.
27.
ScholtenHScheresADe WaterE, et al.Behavioral trainings and manipulations to reduce delay discounting: a systematic review. Psychon Bull Rev2019; 26: 1803–1849.
28.
DogruOXieJPrakashO, et al.Reinforcement learning in process industries: review and perspective. IEEE/CAA J Autom Sinica2024; 11: 283–300.
29.
ZhouCHuangBHassanH, et al.Attention-based advantage actor-critic algorithm with prioritized experience replay for complex 2-D robotic motion planning. J Intell Manuf2023; 34: 151–180.
30.
OroojlooyAHajinezhadD. A review of cooperative multi-agent deep reinforcement learning. Appl Intell2023; 53: 13677–13722.
31.
AbdulazeezDHAskarSK. Offloading mechanisms based on reinforcement learning and deep learning algorithms in the fog computing environment. IEEE Access2023; 11: 12555–12586.
32.
Hernandez-LealPKartalBTaylorME. A survey and critique of multiagent deep reinforcement learning. Auton Agent Multi Agent Syst2019; 33: 750–797.
33.
HooshyarDYousefiMLimH. A systematic review of data-driven approaches in player modeling of educational games. Artif Intell Rev2019; 52: 1997–2017.
