Articles & Content


Move Large Amounts of Data between different Data Marts (I12)

Topic: DB2 for LUW

Subtopic: 2007

DATE: 2007-5-10 (09:20 AM - 10:20 AM)
SPEAKERS: Ping Yuan (Bank of Montreal)

In data warehousing environment, quite often it is required to move large amount of data between different databases on different servers. DBAs can be challenged with the problem of data transfer performance, available disk space or security issues while doing this activity. We investigate and experiment with four different ways of moving data in our data marts.1.Export from remote server and locally load to target database2.Export from local server and remotely load to target database3.Export to a pipe and then load from the pipe to a remote database4.Establish a federated system between the source and target database and load from cursor with the nickname in the federated systemThe pros and cons of each method are described in the paper. The study shows which method is recommended for better data transfer speed and disk space consumption and which are more flexible to use in a secure and structuralzed data warehousing environment in the bank.

EXP. LEVEL: Beginner,Intermediate,Advanced


Challenges of moving large amount of data in different data marts

Available techniques for moving data

Pros and cons of each technique in real life financial data warehousing environments

Performance study and result of each technique

Recommended solution for the problem

Click Here to Download

NOTE: These are only open to members of IDUG. If you are not a member, please CLICK HERE for more information.