all groups > sql server dts > may 2007 >
You're in the

sql server dts

group:

Slow SCD Transform


Slow SCD Transform Scott
5/30/2007 7:27:00 PM
sql server dts:
I am using an SCD transform with a dimension table with 450,000 records. The
SCD is really slow. Does anyone know anything I may be able to do to speed
things up?

Thanks for the help!
Re: Slow SCD Transform Francisco A. Gonzalez
5/31/2007 12:00:00 AM
Hi

If you use profiler to see what SCD does, you will notice that it is not the
best way to do it when the number
You can implement your own SCD, using merge joints, OLEDB commands, and set
updates to speed up your process.

cheers

--

Francisco A. Gonzalez
fgonzalez@solidq.com



[quoted text, click to view]

Re: Slow SCD Transform Scott
5/31/2007 6:21:12 AM
Yup, I'm headed down that path right now. Thanks!

[quoted text, click to view]
Re: Slow SCD Transform Allan Mitchell
5/31/2007 8:43:27 PM
Hello Francisco,


I agree with looking at the output from Profiler but I would also look to
use this info to maybe explore the option of building indexes in the dim
tables to optimise the queries.

If perf is a problem then I would err on not using OLE DB CMD Transforms
as they are a Row*Row operation and a large number of rows passing through
it == painful.

I would be inclined to stage and do a SET based update/delete if perf really
is that bad.



--

Allan Mitchell
http://wiki.sqlis.com | http://www.sqlis.com | http://www.sqldts.com |
http://www.konesans.com

[quoted text, click to view]

Re: Slow SCD Transform Francisco A. Gonzalez
6/7/2007 7:29:09 PM
I agree with you, what I was trying to point is that OLE DB CMD transforms
and the SCD are row by row, and you can notice this using profiler.
I agree with set based updateds.

cheers

--

Francisco A. Gonzalez
fgonzalez@solidq.com



[quoted text, click to view]

AddThis Social Bookmark Button