This study proposes a machine learning-based evaluation function that intentionally weakens the competency level of an AI program based on the game records of amateur players. By regulating the evaluation function, it is possible to intentionally weaken the AI relative to existing methods in an equivalent search space. In addition, a subjective evaluation of naturalness was conducted by using a panel of experts to rate the proposed AI technique against conventional AI techniques at equivalent levels of weakness. The analysis revealed the elements of “human-likeness” present in the shogi game records and identified key similarities and differences between amateur and professional players.
DeepMind Technologies (2017). AlphaGo Teach – Let the AlphaGo Teaching Tool help you find new and creative ways of playing Go. Retrieved February 7, 2018, from https://alphagoteach.deepmind.com/.
2.
Fujii, N., Fukushima, R. & Katayose, H. (2015). Study of user control and experimental techniques in subjective evaluation for entertainment systems. Entertainment Computing Symposium, 2015, 429–434.
3.
Fujii, N., Sato, Y., Wakama, H., Kazai, K. & Katayose, H. (2013). Evaluating human-like behaviors of video-game agents autonomously acquired with biological constraints. International Conference on Advances in Computer Entertainment Technology, 2013, 61–76. doi:10.1007/978-3-319-03161-3_5.
4.
Hoki, K. (2006). Optimal control of minimax search results to learn positional evaluation. The 11th Game Programming Workshop, 2006, 78–83.
5.
Hoki, K. (2011). Bonanza – The computer shogi program. Retrieved February 7, 2017, from http://www.geocities.jp/bonanza_shogi/.
6.
Hoki, K. & Kaneko, T. (2014). Large-scale optimization for evaluation functions with minimax search. Journal of Artificial Intelligence Research, 49, 527–568.
7.
JAIST Cup Game Algorithm Competition Executive Committee (2011). 2011 JAIST cup game algorithm competitions. Retrieved February 7, 2017, from Japan Advanced Institute of Science and Technology website, http://www.jaist.ac.jp/jaistcup2011/index-e.htm.
8.
Kaneko, T. (2012). Evaluation functions of computer shogi programs and supervised learning using game records. Journal of The Japanese Society for Artificial Intelligence, 27(1), 75–82.
9.
Khalifa, A., Isaksen, A., Togelius, J. & Nealen, A. (2016). Modifying MCTS for human-like general video game playing. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (pp. 2514–2520).
10.
Kume, H. (2002). Shogi Club 24 man kyoku shu. Naitai Shuppan Co. ISBN 4931538037.
11.
Li, Y. & Grimbergen, R. (2012). Using evaluation features to adjust game AI to the player level. The 17th Game Programming Workshop, 2012, 134–136.
12.
Livingstone, D. (2006). Turing’s test and believable AI in games. ACM Computers in entertainment, 4(1), 1–13. doi:10.1145/1111293.1111303.
13.
Luong, H.P., Kanazawa, N. & Ikeda, K. (2017). Learning human-like behaviors using neuroevolution with statistical penalties. 2017 IEEE Conference on Computational Inteligence and Games (CIG), 207–214.
14.
Moriwaki, D. & Kaneko, T. (2007). Auto-match server “Floodgate”. Computer Shogi Association Journal, 20, 3–10.
15.
Namai, S. & Ito, T. (2010). A trial system that player feels playing-styles in shogi (pp. 1–7). IPSJ SIG Technical Report, 2010-GI-24(3).
16.
Obata, T., Sugiyama, T., Hoki, K. & Ito, T. (2010). Consultation algorithm for computer shogi: Move decisions by majority. Computers and Games, CG, 2010, 156–165.
17.
Omori, S. & Kaneko, T. (2016). Learning of evaluation functions to realize playing styles in shogi. PRICAI 2016: Trends in Artificial Intelligence: 14th Pacific Rim International Conference on Artificial Intelligence, 367–379.
18.
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., et al. (2017b). Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv:1712.01815.
19.
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., et al. (2017a). Mastering the game of go without human knowledge. Nature, 550, 254–359.
20.
Sweetser, P. & Wyeth, P. (2005). GameFlow: A model for evaluating player enjoyment in games. ACM Computers in Entertainment, 3(3), 1–24. doi:10.1145/1077246.1077253.
21.
The University of Tokyo (2008). Computer Shogi-Server (Floodgate), Retrieved February 7, 2018, from The University of Tokyo, Web site, http://wdoor.c.u-tokyo.ac.jp/shogi/index-e.html.
22.
Yamashita, T. & Okubo, M. (2011). Kyosou aite no nouryoku no chigai ga sagyousya ni oyobosu eikyou. The Information Processing Society of Japan, 261–263.
