Fuzzy Q-Learning with the modified fuzzy ART neural network

Abstract

We present a method to acquire rules for agent behavior, where continuous numeric percepts are classified into categories by fuzzy ART and fuzzy Q-learning is employed to acquire rules. To make fuzzy ART be fit for fuzzy Q-learning, we modify fuzzy ART such that it selects multiple categories for a percept vector and calculate their fitness values. For efficient learning, we also implement category integration that integrates two categories into one in order to reduce the number of categories. Moreover, we modify the choice function to be fit for our modified fuzzy ART and also modify the timing of category integration for efficient learning. Experimental results show that our method acquires good rules for agent behavior more efficiently than Q-learning with fuzzy ART.