Semantic Consistency in Distributed Analytics Systems: A Design Science Approach to Cross-Engine Query Equivalence
Keywords:
Semantic Consistency, Distributed Analytics, Query Engines, Canonical Representation, Design Science ResearchAbstract
Modern analytics systems use multiple, heterogeneous query engines, balancing different requirementsfor performance, scalability, and workload specialization. While the engines share a similar syntax and support dialects of structured query language, they are not semantically equivalent
References
Neoklis Polyzotis et al., "Data Management Challenges in Production Machine Learning," SIGMOD
'17: Proceedings of the 2017 ACM International Conference on Management of Data (May 2017) [Online]. Available: https://dl.acm.org/doi/pdf/10.1145/3035918.3054782
Michael Armbrust et al., "Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics," 11th Annual Conference on Innovative Data Systems Research (CIDR ’21), January 11–15, 2021. [Online]. Available: https://15721.courses.cs.cmu.edu/spring2023/papers/02-modern/armbrust-cidr21.pdf
