Apache Wayang
Jump to navigation
Jump to search
 | The topic of this article may not meet Wikitia's general notability guideline. |
| Stable release | 0.6
|
|---|---|
| Repository | https://github.com/apache/incubator-wayang |
| Written in | Java |
| Platform | Cross-platform |
| License | Apache License 2.0 |
| Website | wayang |
Apache Wayang is a meta-processing framework that allows users to run data processing applications on multiple platforms without changing the native code. Wayang provides an abstraction[1][2] on top of existing platforms and uses machine learning to cost-optimize[3] data processing queries. Wayang is currently part of the Apache incubator.
Architecture
Wayang has a three-layer architecture:
- The application layer models all application-specific logic
- The core layer provides the intermediate representation between applications and processing platforms
- The platform layer connects and executes the underlying processing platform tasks
Features
Wayang supports[4] the following data processing platforms:
- Java Streams
- Apache Spark
- Apache Flink
- Apache Giraph
- GraphChi
- PostgreSQL
- SQLite
See also
- List of Apache Software Foundation projects
- Federated Learning
References
- ↑ Agrawal, Divy; Ba, Lamine; Berti-Equille, Laure; Chawla, Sanjay; Elmagarmid, Ahmed; Hammady, Hossam; Idris, Yasser; Kaoudi, Zoi; Khayyat, Zuhair; Kruse, Sebastian; Ouzzani, Mourad; Papotti, Paolo; Quiane-Ruiz, Jorge-Arnulfo; Tang, Nan; Zaki, Mohammed J. (2016-06-26). "Rheem: Enabling Multi-Platform Task Execution". Proceedings of the 2016 International Conference on Management of Data. SIGMOD '16. New York, NY, USA: Association for Computing Machinery: 2069–2072. doi:10.1145/2882903.2899414. ISBN 978-1-4503-3531-7.
- ↑ "The research paper "Apache Wayang: A Unified Data Analytics Framework" has been accepted for publication in the SIGMOD Record 2023". www.tu.berlin. 2023-07-20. Retrieved 2023-07-26.
- ↑ Kaoudi, Zoi; Quiané-Ruiz, Jorge-Arnulfo; Contreras-Rojas, Bertty; Pardo-Meza, Rodrigo; Troudi, Anis; Chawla, Sanjay (April 2020). "ML-based Cross-Platform Query Optimization". 2020 IEEE 36th International Conference on Data Engineering (ICDE). pp. 1489–1500. doi:10.1109/ICDE48307.2020.00132. ISBN 978-1-7281-2903-7.
- ↑ Apache Wayang (incubating), The Apache Software Foundation, 2023-07-03, retrieved 2023-07-07
External links
This article "Apache Wayang" is from Wikipedia. The list of its authors can be seen in its historical. Articles taken from Draft Namespace on Wikipedia could be accessed on Wikipedia's Draft Namespace.