Articles & Content


Move Large Amounts of Data between different Data Marts (I12)

Topic: 2007 NA

Subtopic: DB2 for LUW

DATE: 2007-5-10 (09:20 AM - 10:20 AM)
SPEAKERS: Ping Yuan (Bank of Montreal)

In data warehousing environment, quite often it is required to move large amount of data between different databases on different servers. DBAs can be challenged with the problem of data transfer performance, available disk space or security issues while doing this activity. We investigate and experiment with four different ways of moving data in our data marts.1.Export from remote server and locally load to target database2.Export from local server and remotely load to target database3.Export to a pipe and then load from the pipe to a remote database4.Establish a federated system between the source and target database and load from cursor with the nickname in the federated systemThe pros and cons of each method are described in the paper. The study shows which method is recommended for better data transfer speed and disk space consumption and which are more flexible to use in a secure and structuralzed data warehousing environment in the bank.

EXP. LEVEL: Beginner,Intermediate,Advanced


Challenges of moving large amount of data in different data marts

Available techniques for moving data

Pros and cons of each technique in real life financial data warehousing environments

Performance study and result of each technique

Recommended solution for the problem

This file is being provided by IDUG. We would encourage you to join IDUG to get full access to all of our files and resources. Joining IDUG is FREE and signing up is simple. Click here to join! or login!

Download File
Click to Download

NOTE: These are only open to members of IDUG. If you are not a member, please CLICK HERE for more information.