Mike Ault's thoughts on various topics, Oracle related and not. Note: I reserve the right to delete comments that are not contributing to the overall theme of the BLOG or are insulting or demeaning to anyone. The posts on this blog are provided “as is” with no warranties and confer no rights. The opinions expressed on this site are mine and mine alone, and do not necessarily represent those of my employer.

Friday, February 05, 2010

Loading in Oracle

Well, in the past several weeks I have done some interesting tests in loading in Oracle. It seems there is something inside Oracle itself that is limiting the amount of data that an be loaded through a single instance in a given time frame. About the best numbers for a single instance, parallel DML or not, was between 70-100 megabytes per second.

Now using RAC and going with multiple instances I was able to increase that number as a factor of the number of nodes. However that seems to be a very complex method.

So, anyone out there have some good tips for loading data quickly into Oracle? Currently I am going from a memory cache (filesystem) using external tables directly into an internal table, use of APPEND made no difference since the table is new.

Eventually I would use the table to do a partition swap as soon as the table reaches a specific size and start a new table loading. For right now I just have to maximize the load speed going from an external table to an internal one.

Anyway, I will post more information as I find more.


No comments: