Abnormal actions detection of robotic arm via 3D convolution neural network and support vector data description

Abstract

Robotic arms are powerful assistants in many industrial production environments, and they run periodically in accordance with preset actions to complete specified operations. However, they may act abnormally when encountering unexpected situation and then lead to unnecessary loss. Recognizing the abnormal actions of robotic arms through surveillance video can automatically help us to understand their operating status and discover possible abnormalities in time. We designed a deep learning architecture based on 3D convolution for abnormal action recognition. The 3D convolutional layer can extract the spatial and temporal features of the robotic arm movements from the video frame difference sequence. The features are compressed and streamlined by the maximum pooling layer to obtain concise and effective robotic arm action features. Finally, the fully connected layer is used to classify the features to recognize the abnormal robotic arm tasks. Support vector data description (SVDD) model is employed to detect abnormal actions of the robotic arm, and the well-trained SVDD model can distinguish the normal actions from the three kinds of abnormal actions with the Area Under Curve (AUC) 99.17%.