all groups > sql server dts > february 2007 >
You're in the

sql server dts

group:

ETL rejects records intermittently


ETL rejects records intermittently Jyoti Khetan
2/27/2007 12:00:00 AM
sql server dts:
Hello,

The problem I am facing is quite weird. When I execute the SSIS package
sometimes it rejects the correct data as well. And when the package is
executed again, the data which it rejected last time is not rejected this
time. Also sometimes the package is executed and no data is rejected for the
first time but in the subsequent execution of package with the same data, it
rejects some of the records.

I am relatively new to SSIS. Please help me out. Thanks in advance.

Regards,

Jyoti

Re: ETL rejects records intermittently JXStern
2/27/2007 8:15:25 AM
On Tue, 27 Feb 2007 15:50:45 +0530, "Jyoti Khetan"
[quoted text, click to view]

What kind of data, ascii flat or csv import?

Because I've seen that behavior in DTS, it's apparently a problem with
the OLEDB connection/driver. One workaround is to use the old ODBC
connection, it uses the same driver but apparently it at least gives
another data path and has worked for me.

J.
Re: ETL rejects records intermittently Jyoti Khetan
2/28/2007 12:00:00 AM
The data source is the SQL SERVER 2005 table. We first dump the data from
the source SQL SERVER 2005 database to the staging environment and then
cleanse it. During cleansing sometimes it rejects the correct data as well.
And this too on the adhoc basis. I mean sometimes it rejects some of the
records and sometimes the same records are cleansedd successfully. I dont
think it has anyting to do with the OLEDB connection/driver.

[quoted text, click to view]

Re: ETL rejects records intermittently Allan Mitchell
3/3/2007 12:00:00 AM
Do you need to dump to disk to do the cleansing? That is more ELT than
ETL (but it does still have its uses).

That apart. You should not be losing rows. Can you consistently
reproduce the problem? When it works is it allowing the exact same
data? At what point are you losing rows?

--


Allan Mitchell
http://wiki.sqlis.com | http://www.sqlis.com | http://www.sqldts.com |
http://www.konesans.com



[quoted text, click to view]
AddThis Social Bookmark Button