Designing Self-Healing Data Pipelines for Autonomous and Continuous AI Operations
Keywords:
Self-healing pipelines, Bayesian networks, anomaly detection, AI operations, automated remediation, scalability and performance evaluation.Abstract
This study design and analyzes a selfhealing data pipeline to perform ongoing AIprocesses, with special interest in anomaly detection,root-cause detection and automated remediation. The pipeline includes the methods used, whichinclude Z-score anomaly detection
References
Steenwinckel, B., De Paepe, D., Vanden Hautte, S., Heyvaert, P., Bentefrit, M., Moens, P., Dimou, A., Van Den Bossche, B., De Turck, F., Van Hoecke, S. and Ongenae, F., 2021. FLAGS: A methodology for adaptive anomaly detection and root cause analysis on sensor data streams by fusing expert knowledge with machine learning. Future Generation Computer Systems, 116, pp.30-48.


