Enhancing IoT data analytics with deep learning-based anomaly detection and real-time processing on edge devices

Abstract

The Internet of Things (IoT) is an essential component of the digital age, particularly in ensuring reliable and efficient operations as well as the timely and precise recognition of anomalies within IoT systems. However, anomaly detection in time-series data—especially data collected by edge devices—poses several challenges, including concerns over data privacy and communication overhead. To address these issues, this research proposes a novel deep learning (DL)-based anomaly detection model capable of being trained in real-time on edge devices within an IoT environment. The framework ensures user privacy by enabling distributed edge devices to cooperatively train an anomaly recognition system. This study introduces a new, Intelligent Shark Smell Tuned Deep Isolation Forest (ISS-DIF), which effectively detects anomalies and identifies outliers in industrial IoT sensor data with high accuracy. The hybrid model isolates anomalies rather than profiling normal data, making it particularly suitable for identifying rare anomalies within large datasets. Industrial data are collected from real-world manufacturing environments using IoT edge devices. Following data collection, median filtering is applied to reduce noise, and min-max scaling is employed for data normalization. The ISS component allows for fine-tuning the hyperparameters of the Deep Isolation Forest (DIF) to optimize detection performance. The DIF model is tailored to enhance anomaly detection capabilities in sensor data from industrial IoT applications. For validation, 80% of the dataset was used for training, while the remaining 20% served as the test set. The results demonstrate that the proposed ISS-DIF framework achieved superior training accuracy of 99.30%, with precision of 97.89%, recall of 98.76%, and an F1-score of 97.21%, outperforming the testing metrics. This approach integrates real-time anomaly detection with the processing capabilities of edge devices, thereby improving IoT data analytics and providing a scalable, efficient solution that preserves privacy in irregularity recognition within IoT environments.