EXTRACTION TRANSFORMATION LOAD (ETL) SOLUTION FOR DATA INTEGRATION: A CASE STUDY OF RUBBER IMPORT AND EXPORT INFORMATION
DOI:
https://doi.org/10.11113/jt.v78.4061Keywords:
Data integration, ETL, Microsoft SSIS, ETL schedulingAbstract
Data integration is important in consolidating all the data in the organization or outside the organization to provide a unified view of the organization's information. Extraction Transformation Load (ETL) solution is the back-end process of data integration which involves collecting data from various data sources, preparing and transforming the data according to business requirements and loading them into a Data Warehouse (DW). This paper explains the integration of the rubber import and export data between Malaysian Rubber Board (MRB) and Royal Malaysian Customs Department (Customs) using the ETL solution. Microsoft SQL Server Integration Services (SSIS) and Microsoft SQL Server Agent Jobs have been used as the ETL tool and ETL scheduling.Â
References
Lingli, Z., et al. 2009. The Research and Design of Data Integration System for Urbanization. 831-834.
Chowdhury, J. L. a. S. 2004. Best Practices in Data Warehousing to Support Business Initiatives and Needs.
Mrunalini, M., T. V. S. Kumar, and K. R. Kanth. 2009. Simulating Secure Data Extraction in Extraction Transformation Loading (ETL) Processes. 142-147.
Ghosh, S., S. Goswami, and A. Chakrabarti. 2011. Outlier detection from ETL Execution Trace. 343-347.
Kimball, R. and J. Caserta. 2009. The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data.
Alkis Simitsis, K. W. and M. C. Umeshwar Dayal. 2010. Optimizing ETL Workflows for Fault-Tolerance. 385-396.
Pethalakshmi, A. P. a. D. A. 2013. Novel Approach in ETL. 429-434.
Eckerson, W. and C. White. 2003. Evaluating ETL and Data Integration Platforms.
Jun, T., et al. 2009: The Research & Application of ETL Tool in Business Intelligence Project. 620-623.
Sun, K. and Y. Lan. 2012. SETL: A Scalable And High Performance ETL System. 6-9.
P.Muthukumar, et al. 2012. A Realistic Approach for the Deployment of National Knowledge Repositories by Leveraging ETL Tools. 542-547.
Xishui Pan, H. S., Runshun Zhang and T. Z. Xuezhong Zhou. 2012. Enhanced Data Extraction, Transforming and Loading Processing for Traditional Chinese Medicine Clinical Data Warehouse. 57-61.
Nithin Vijayendra, a. M. L. 2013. A Web-based ETL Tool for Data Integration Process. IEEE Conference Publications. 434-438.
Anand, N. and M. Kumar. 2013. Modeling and Optimization of Extraction-Transformation-Loading (ETL) processes in Data Warehouse: An Overview. 1-5.
Nayem, R., M. Jessica, and A. Shameem. 2012. An ETL Metadata Model for Data Warehousing. Journal of Computing and Information Technology. 20(2).
Jian, L. and X. Bihua. 2010. ETL Tool Research and Implementation Based on Drilling Data Warehouse. Seventh International Conference on Fuzzy Systems and Knowledge Discovery. 2567-2569.
Ying Pei, J. X. and Q. Wang. 2010. One CWM-based Data Transformation Method in ETL Process. 1-4.
Henn, S. and S. Hoon. 2005. Engineering Trade Study: Extract, Transform, Load Tools For Data Migration. 1-8.
Pall, A. S. and D. J. S. Khaira. 2013. A comparative Review of Extraction, Transformation and Loading Tools. Database Systems Journal. IV(2): 42-51.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
