Author(s)

Maria Gonzalez, Elena Ruiz, Antonio Perez^*

Affiliation(s)

Department of Computer Engineering, University of Malaga, Malaga, Spain. 

Corresponding Author

Antonio Perez

ABSTRACT

This paper presents the Temporal Logical Attention Network, a novel approach to anomaly detection in distributed systems logs. As distributed systems become increasingly integral to modern applications, the complexity and volume of log data generated pose significant challenges for effective monitoring and analysis. Traditional methods for anomaly detection, such as rule-based and statistical techniques, often fall short in addressing the dynamic nature of log data, resulting in high false positive rates and inadequate detection of subtle anomalies. TLAN leverages deep learning, specifically attention mechanisms, to capture temporal dependencies and logical relationships within log data. By embedding log entries into a dense vector space and applying temporal encoding, TLAN identifies significant patterns over time, enhancing the accuracy of anomaly detection. The model focuses on relevant log entries, allowing it to prioritize critical information while minimizing the influence of less significant data. Through rigorous experimentation on multiple datasets, TLAN demonstrated superior performance compared to traditional and state-of-the-art models, achieving high precision, recall, and F1-scores. The findings underscore TLAN's effectiveness in identifying anomalies that may indicate underlying issues, such as security breaches or system failures.

This research contributes to the evolving landscape of anomaly detection techniques, highlighting the importance of integrating advanced machine learning approaches in managing distributed systems logs. Ultimately, TLAN represents a significant advancement in the field, offering organizations robust tools for enhancing the security and reliability of their distributed environments.

KEYWORDS

Anomaly detection; Distributed systems; Temporal logical attention network

CITE THIS PAPER

Maria Gonzalez, Elena Ruiz, Antonio Perez. A temporal logical attention network approach to anomaly detection in distributed systems logs. AI and Data Science Journal. 2024, 1(1): 29-36. DOI: https://doi.org/10.61784/adsj3004.

REFERENCES

[1] Erhan L, Ndubuaku M, Di Mauro, et al. Smart anomaly detection in sensor systems: A multi-perspective review. Information Fusion, 2021, 67: 64-79.

[2] Wang X, Wu Y C, Ji X, et al. Algorithmic discrimination: examining its types and regulatory measures with emphasis on US legal practices. Frontiers in Artificial Intelligence, 2024, 7: 1320277.

[3] Protogerou A, Papadopoulos S, Drosou A, et al. A graph neural network method for distributed anomaly detection in IoT. Evolving Systems, 2021, 12(1): 19-36.

[4] Wang X, Wu Y C, Zhou M, Fu H. Beyond surveillance: privacy, ethics, and regulations in face recognition technology. Frontiers in big data, 2024, 7: 1337465.

[5] Martins I, Resende J S, Sousa P R, et al. Host-based IDS: A review and open issues of an anomaly detection system in IoT. Future Generation Computer Systems, 2020, 133: 95-113.

[6] Liu Y, Hu X, Chen S. Multi-Material 3D Printing and Computational Design in Pharmaceutical Tablet Manufacturing. Journal of Computer Science and Artificial Intelligence, 2024.

[7] Diro A, Chilamkurti N, Nguyen V D, et al. A comprehensive study of anomaly detection schemes in IoT networks using machine learning algorithms. Sensors, 2021, 21(24): 8320.

[8] Wang M. AI Technologies in Modern Taxation: Applications, Challenges, and Strategic Directions. International Journal of Finance and Investment, 20204, 1(1): 42-46.

[9] Mothukuri V, Khare P, Parizi R M, et al. Federated-learning-based anomaly detection for IoT security attacks. IEEE Internet of Things Journal, 2021, 9(4): 2545-2554.

[10] Qiu L. DEEP LEARNING APPROACHES FOR BUILDING ENERGY CONSUMPTION PREDICTION. Frontiers in Environmental Research, 2024, 2(3): 11-17.

[11] Zhang X, Li P, Han X, et al. Enhancing Time Series Product Demand Forecasting with Hybrid Attention-Based Deep Learning Models. IEEE Access, 2024.

[12] Diro A, Chilamkurti N, Nguyen V D, et al. A comprehensive study of anomaly detection schemes in IoT networks using machine learning algorithms. Sensors, 2021, 21(24): 8320.

[13] Li P, Ren S, Zhang Q, Wang X, Liu Y. Think4SCND: Reinforcement Learning with Thinking Model for Dynamic Supply Chain Network Design. IEEE Access, 2024.

[14] Shaukat K, Alam T M, Luo S, Set al. A review of time-series anomaly detection techniques: A step to future perspectives. In Advances in Information and Communication: Proceedings of the 2021 Future of Information and Communication Conference (FICC). Springer International Publishing, 2021, 1: 865-877.

[15] Truong H T, Ta B P, Le Q A, et al. Light-weight federated learning-based anomaly detection for time-series data in industrial control systems. Computers in Industry, 2022, 140: 103692.

[16] Liu Y, Ren S, Wang X, Zhou M. Temporal Logical Attention Network for Log-Based Anomaly Detection in Distributed Systems. Sensors, 2024, 24(24): 7949.

[17] Tuli S, Casale G, Jennings N R. Tranad: Deep transformer networks for anomaly detection in multivariate time series data. 2022.

[18] Kasim O. An efficient and robust deep learning based network anomaly detection against distributed denial of service attacks. Computer Networks, 2020, 180: 107390.

[19] Zhang X, Chen S, Shao Z, et al. Enhanced Lithographic Hotspot Detection via Multi-Task Deep Learning with Synthetic Pattern Generation. IEEE Open Journal of the Computer Society, 2024.

[20] Thudumu S, Branch P, Jin J, Singh J. A comprehensive survey of anomaly detection techniques for high dimensional big data. Journal of Big Data, 2020, 7: 1-30.

[21] Guezzaz A, Asimi Y, Azrour M, et al. Mathematical validation of proposed machine learning classifier for heterogeneous traffic and anomaly detection. Big Data Mining and Analytics, 2021, 4(1): 18-24.

[22] Chatterjee A, Ahmed B S. IoT anomaly detection methods and applications: A survey. Internet of Things, 2022, 19: 100568.

[23] Siniosoglou I, Radoglou-Grammatikis P, Efstathopoulos G, et al. A unified deep learning anomaly detection and classification approach for smart grid environments. IEEE Transactions on Network and Service Management, 2021, 18(2): 1137-1151.