INTERNAL (Information System Journal)
Vol. 4 No. 2 (2021)

Analisis Dynamic ETL Incremental Load untuk Data Integration Datawarehouse

Zulkifli Arsyad (Politeknik Negeri Bandung)



Article Info

Publish Date
30 Dec 2021

Abstract

Data integration is a combination of techniques and businesses that are used to collect data from different sources into useful and valuable information ETL process that includes extracting data from various data sources, transforming data to form and calculate data and load data on target storage, to support data warehouse need. Based on organizations and industries that have implemented data warehouse, the problem that generally arises regarding data load is the difficulty in integrating different data sources, how to form data from various data formats into uniform data, how to integrate data delta between data sources and target storage in an incremental load process so that this data synchronization process can be carried out continuously and relatively faster. ETL process requires a platform that can facilitate data integration needs, in order to run this process. SSIS (SQL Server Integration Service) is a Data Integration platform to build an enterprise-level data integration and solutions for data transformation. Integration Service can extract and change data (transform) from various sources such as XML data files, flat files, APIs, and relational data sources, and then load into one or several destination data. According to the problem related to data load, we will examine how the solution model uses SSIS for the ETL process. This paper proposed an ETL Architecture model by completing the ETL process for full & incremental load extraction and the original data layer.

Copyrights © 2021






Journal Info

Abbrev

internal

Publisher

Subject

Computer Science & IT Education Other

Description

INTERNAL (Information System Journal) is a scientific journal published by the Information Systems Study Program, Masoem University. This journal is a forum for publication of scientific papers in the form of writings by academics, researchers and practitioners on pure and applied research in the ...