sql server dts: Slow Data Load -- sql server dts

Slow Data Load

Abraham
9/30/2003 1:19:33 PM

sql server dts:

A daily export from an oracle instance has 360,000+
records in it - txt file ~ delimited. The data is loaded
into a table (via DTS) that does NOT have straight column
copies; some of the fields are using the activex to
ensure length or other when it comes to zip or phone
numbers. This is a painfully slow process. This is
sql7sp3 running on win2k. Is there some place I can
start to look to speed this up sans removal of the
activex portion? Does this sound normal? In the
neighborhood of 1hour 20 minutes for the complete load.

Thank you for the time.

Regards,

Re: Slow Data Load

Sue Hoegemeier
9/30/2003 6:25:12 PM

It may be quicker to load the text file directly into a
staging table and then clean up from there using T-SQL.
Just a thought. I've had some similar scenarios where this
was a better option for performance, tracking data issues,
etc.

-Sue

On Tue, 30 Sep 2003 13:19:33 -0700, "Abraham"
[quoted text, click to view]

Re: Slow Data Load

Allan Mitchell
10/1/2003 7:22:28 AM

When dealing with text files I invariably load to a scratch table and then
use TSQL to load into the real destination. I find messing about with text
files mid stream to be expensive.

--
--

Allan Mitchell (Microsoft SQL Server MVP)
MCSE,MCDBA
www.SQLDTS.com
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org

[quoted text, click to view]

Got something to say? Click here to post a reply to this thread.

Don't see what you're looking for? Try a search.

View other messages in the sql server dts group.