Submit your papersSubmit Now
For Enquiries: [email protected]
IIARD LogoIIARD

Hybrid ARIMA-LSTM Model for Anomaly Detection in Streamed Time-Series Data

Sako, D.J.S., Marcus, P.U. , Deedam, F.B.

Abstract

The exponential growth of data generated by wireless sensor networks , Internet of Things devices, and real-time monitoring systems has heightened the need for accurate and scalable anomaly detection techniques in streamed time-series data. Traditional statistical models, including ARIMA, provide advantages such as interpretability and reduced computational demands; however, they exhibit limitations when handling non-linear dynamics. In contrast, deep learning models, exemplified by LSTM, demonstrate robust performance capabilities but face challenges related to transparency and higher computational costs. This study proposes a hybrid Auto Regressive Integrated Moving Average and Long Short- Term Memory networks to enhance anomaly detection in real-time streaming environments. The proposed method integrates ARIMA to model linear patterns and LSTM to learn the residual non-linear components. The Residuals from ARIMA are transformed into an LSTM model trained to forecast error corrections. Anomaly detection is implemented using exponential moving average model by monitoring deviations from expected values using a threshold mechanism. Extensive experiments were conducted using misconfiguration of CPU utilization in AWS Auto Scaling Groups dataset. The hybrid model demonstrated superior performance compared to the standalone ARIMA and LSTM models in most of the evaluated scenarios. It achieved an accuracy of 99%, precision of 99%, recall of 99% and F1- score of 98% on the full dataset. The ARIMA-LSTM hybrid framework offers a robust performance and solution characterized by interpretability, scalability, and accuracy that make it an ideal system for real-time, high-stakes anomaly detection in dynamic streaming environments.

Keywords

Anomaly detectionARIMALSTMhybrid modelAmazon Web Services

References

Abdella, J., & Zong, W. (2018). Anomaly detection using deep learning: A survey. Journal of Big Data, 5(1), 19. https://doi.org/10.1186/s40537-018-0145-2 Aboah, A., Shoman, M., Mandal, V., Davami, S., Adu-Gyamfi, Y., & Sharma, A. (2021, June). A vision-based system for traffic anomaly detection using deep learning and decision trees. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (pp. 4207–4212). IEEE. https://doi.org/10.1109/CVPRW53098.2021.00475 Aboah, R., Mensah, A., & Asante, E. (2021). Hybrid CNN-LSTM approach for anomaly detection in multivariate time-series data. Journal of Applied Artificial Intelligence Research, 5(2), 45–56. Ai, Q., Tian, H., Wang, H., Lang, Q., Huang, X., Jiang, X. and Jing, Q. (2024). Comparative Analysis of ARIMA and LSTM Model-Based Anomaly Detection for Unannotated Structural Health Monitoring Data in an Immersed Tunnel, CMES - Computer Modeling in Engineering and Sciences, 139(2), 1797-1827. https://doi.org/10.32604/cmes.2023.045251. Akouemo, H. N., & Povinelli, R. J. (2016). Probabilistic anomaly detection in natural gas time series data. International Journal of Forecasting, 32(3), 948–956. https://doi.org/10.1016/j.ijforecast.2015.06.001 Angiulli, F., & Pizzuti, C. (2002). Fast outlier detection in high-dimensional spaces. In Proceedings of the 6th European Conference on Principles of Knowledge Discovery and Data Mining (PKDD 2002) (pp. 15–26). Springer. https://doi.org/10.1007/3-540- 45681-3_2 Arundo, M., & Bhatnagar, R. (2018). Scalable anomaly detection in streaming time series data. International Journal of Data Science and Analytics, 6(4), 325–337. https://doi.org/10.1007/s41060-018-0106-9 Athiyarath, M.P., Srihari and Krishnaswamy, S. (2020). A comparative study and analysis of time series forecasting techniques, SN Computer Science, 1(3). Bengio, Y.; Simard, P.; Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult, IEEE Trans. Neural Netw. 1994, 5, 157–166. Box, G. E. P., Jenkins, G. M., Reinsel, G. C., & Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, 5th Edition. Wiley. Buda, T. S., Szekely, A., & Hossain, M. S. (2020). Anomaly detection in IoT sensor data using deep learning. Sensors, 20(13), 3726. https://doi.org/10.3390/s20133726 Carlo, C. (2023).Anomaly detection for Time Series Analysis. Accessed 10-Dec-2025 from https://medium.com/aimonks/anomaly-detection-for-time-series-analysis- eeecd6282f53 Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys, 41(3), 15. https://doi.org/10.1145/1541880.1541882 Chen, J., Jiang, X., Yan, Y., Lang, Q and Wang, H. (2022). Dynamic Warning method for structural health monitoring data based on ARIMA: Case study of Hong Kong-Zhuhai- Macao Bridge immersed tunnel, Sensors, 22 (16), 6185 Davies, D. (2025). Anomaly detection: A hands-on guide with W&B Weave. https://medium.com/online-inference/anomaly-detection-is-a-machine-learning- technique-for-identifying-data-points-events-or-patterns-8055dcf476ff. Accessed 27- Dec-2025 Gers, F.A., Schmidhuber, J. and Cummins, F. (2000). Learning to Forget: Continual Prediction with LSTM, Neural Computation. 12 (10): 2451–2471. CiteSeerX 10.1.1.55.5709. doi:10.1162/089976600300015015. PMID 11032042. S2CID 11598600. E- ISSN 2489-009X , Graves, A (2013). Generating sequences with recurrent neural networks. arXiv 2013, arXiv:1308.0850. Hochreiter, S.; Schmidhuber, J. (1997). Long short-term memory, Neural Comput., 9, 1735– 1780. https://www.bioinf.jku.at/publications/older/2604.pdf Khadsan, S (2025). How to Use AWS CloudWatch for Real-Time Monitoring and Alerts, Lavin, A.; Ahmad, S. (2015). Evaluating Real-Time Anomaly Detection Algorithms—The Numenta Anomaly Benchmark. In Proceedings of the 2015 IEEE 14th International Conference on Machine Learning and Applications , Miami. dx.doi.org/10.1109/icmla.2015.141 Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S. K. (2019). MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks. In Proceedings of the 28th International Conference on Artificial Neural Networks (ICANN 2019) (pp. 703–716). Springer. https://doi.org/10.1007/978-3-030-30490-4_56 Lin, M., Lin, W., Wang, Q and Wang, X. (2018). The deployable element, a new closure joint construction method for immersed tunnel, Tunnelling and Underground Space Technology, 80, 290-300 Lu, C., Huang, J., & Ling, C. X. (2013). Online anomaly detection in structural health monitoring using statistical learning. Structural Health Monitoring, 12(4), 321–332. https://doi.org/10.1177/1475921713484246 Moraes, L. (2020). Anomaly Detection - Streaming Data, https://www.kaggle.com/code/leomauro/anomaly-detection-streaming- data/input Robin, R.R. (2025). LSTM RNN: An In-depth Look at its Architecture, Accessed 10-Dec-2025 https://medium.com/@robin5002234/lstm-rnn-an-in-depth-look-at-its-architecture- 749c1d26abcf Talloju, M & Medisetti (2022). Hybrid ARIMA-LSTM Anomaly Detection Model in IOT Networks. Accessed 12-Dec-2025. https://gannon.contentdm.oclc.org/digital/collection/p15946coll13/id/959/ Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., & Chen, H. (2019). A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 33, pp. 1409–1416). AAAI. https://doi.org/10.1609/aaai.v33i01.33011409 Zhang, J., & Zulkernine, M. (2006). Anomaly based network intrusion detection with unsupervised outlier detection. In Proceedings of the 2006 IEEE International Conference on Communications, Circuits and Systems, Volume 2 (pp. 548–552). IEEE. https://doi.org/10.1109/ICCCAS.2006.285815 Zhang, M., Guo, J., Li, X. and Jin, R. (2020). Data-Driven Anomaly Detection Approach for Time-Series Streaming Data, Sensors, 20, 5646; doi:10.3390/s20195646 Zhang, T., Chen, C., Wang, L., Xu, J., & Sun, L. (2020). A deep anomaly detection model for streaming time series with hierarchical attention mechanism. Knowledge-Based Systems, 187, 104824. https://doi.org/10.1016/j.knosys.2019.06.015 Zhang, Y., Meratnia, N., & Havinga, P. J. M. (2010). Outlier detection techniques for wireless sensor networks: A survey. IEEE Communications Surveys & Tutorials, 12(2), 159– 170. https://doi.org/10.1109/SURV.2010.021510.00088 Zhang, Y., Qin, X., & Wang, H. (2016). A multi-scale convolutional recurrent network for anomaly detection in time series data. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (pp. 1702–1708). AAAI Press.