
تعداد نشریات | 162 |
تعداد شمارهها | 6,693 |
تعداد مقالات | 72,239 |
تعداد مشاهده مقاله | 129,233,789 |
تعداد دریافت فایل اصل مقاله | 102,068,096 |
DataBay: A Unified Platform for Automating Data Warehouse Management, Real-Time Data Processing, and Ensuring Data Quality and Monitoring | ||
Journal of Algorithms and Computation | ||
دوره 56، شماره 2، اسفند 2024، صفحه 75-88 اصل مقاله (1.27 M) | ||
نوع مقاله: Research Paper | ||
شناسه دیجیتال (DOI): 10.22059/jac.2025.389920.1222 | ||
نویسندگان | ||
Mostafa Ghadimi* 1؛ Niyusha Baghayi2؛ Alireza Shateri2 | ||
1ut.ac.ir | ||
2databurst.tech | ||
چکیده | ||
As organizations increasingly depend on large-scale data for strategic decision-making, managing data warehouses has become a complex and resource-intensive challenge. This paper introduces DataBay, a unified platform designed to automate the entire data warehouse lifecycle, from data ingestion and transformation to real-time processing, monitoring, and ensuring data quality. DataBay leverages Avro for data serialization, providing optimal throughput and storage efficiency. Additionally, its automated data pipeline orchestration, along with built-in data quality checks, enhances the reliability and accuracy of insights derived from the data. The platform’s architecture is highly scalable, supporting enterprise-level datasets and adapting to evolving business needs. Through its seamless integration and flexibility, DataBay helps businesses make timely, data-driven decisions and enables continuous optimization of data workflows. This paper discusses the platform’s architecture, its implementation in real-world industry settings, and the significant business value it delivers by enhancing operational efficiency and empowering data-driven decision-making across organizations. | ||
کلیدواژهها | ||
Data Warehouse؛ Data Engineering؛ Real-time Data Processing؛ Data Quality؛ Data Management؛ Business Intelligence؛ Data Transformation؛ Data Monitoring؛ Scalable Data Platform | ||
آمار تعداد مشاهده مقاله: 48 تعداد دریافت فایل اصل مقاله: 72 |