Middleware ETL with CDC based on Event Driven Programming
on
Authors:
I Gede Adnyana, Made Sudarma, Wayan Gede Ariastina
Abstract:
“To achieve the real time data warehouse is strongly influenced by the process in the data warehouse known as Extract, Tranform, Loading (ETL). One way to optimize the ETL process is processing only data that undergoes changes on the On Line Transaction Processing (OLTP) system. This technique is known as Change Data Capture (CDC) which is designed to maximize the efficiency of the ETL process. In this research middleware was built as a place where the ETL process will be carried out, transaction data from the OLTP system will be captured and sent directly to the middleware for further processing. The method used to capture changes in OLTP systems is Change Data Capture (CDC) based on Event Driven Programming, where this technique relies on events that occur in OLTP in capturing data changes. Functional testing is done by making a simulation of the insert and update processes in test applications namely OLTP CRM system.The results of the research obtained are (1) Change Data Capture (CDC) based on Event Driven Programming can capture changes in data that occur in OLTP CRM database;(2) ETL process to load data from Normalized Data Store (NDS ) to data warehouse with Timestamp technique can load data that only undergoes changes that are processed to be loaded in Data Warehouse;(3) An increase in the amount of data that is processed has an effect on increasing processing time. Other factors that affect the value of process time are execution plan and cache memory”
Keywords
Keyword Not Available
Downloads:
Download data is not yet available.
References
References Not Available
PDF:
https://jurnal.harianregional.com/ijeet/full-45592
Published
2019-01-15
How To Cite
ADNYANA, I Gede; SUDARMA, Made; GEDE ARIASTINA, Wayan. Middleware ETL with CDC based on Event Driven Programming.International Journal of Engineering and Emerging Technology, [S.l.], v. 3, n. 2, p. 1–4, jan. 2019. ISSN 2579-5988. Available at: https://jurnal.harianregional.com/ijeet/id-45592. Date accessed: 28 Aug. 2025.
Citation Format
ABNT, APA, BibTeX, CBE, EndNote - EndNote format (Macintosh & Windows), MLA, ProCite - RIS format (Macintosh & Windows), RefWorks, Reference Manager - RIS format (Windows only), Turabian
Issue
Vol 3 No 2 (2018): July - December
Section
Articles
Copyright
This work is licensed under a Creative Commons Attribution 4.0 International License
Discussion and feedback