all groups > sql server dts > january 2007 >
You're in the

sql server dts

group:

Dtsx and Fuzzy Lookup Bug ?


Dtsx and Fuzzy Lookup Bug ? glovemtb
1/31/2007 6:12:14 AM
sql server dts:
Tools : Sql Server Enterprise 2005 , Visual Studio 2005, SSIS/DTSX,
oledb datasouces SQL Server 2000.
Testing the new tools specifically Dtsx Fuzzy lookup tool here is I
think the bug.
Entering new values into the reference lookup table and even with the
"create new index" option selected in Fuzzy Lookup; the new records
are not correctly matched. Only the original ones in the lookup table.
Here is step by step to reproduce the issue:
1-I simply "select into" to create a "UserLookup" reference table say
4 records from a Users table that I want to do fuzzy lookup on the
Oledb datasouce (Sql Server 2k database) LastName and FirstName are
the fuzzy lookup criteria columns.
So the oledb datasource table is Users and the reference table for the
fuzzy lookup is UserLookup.
2- Everything works fine and with a conditional split I get the 4
matched records in the UserMatch destination and the rest unmatched in
the UserNomatch tables.
3- But, If I edit the UserLookup table, by putting in a new record
that should match the fuzzy lookup, it does not pick it up when I re-
run the package. Even with the create new index option on in the fuzzy
lookup reference table options.
My question is could this be a index caching issue ?
Not a good thing if you have lookups on dynamic tables that an
application is attached to and you expect to be able to edit and place
in new records all the time to do fuzzy lookups on.
You would not want to have to dbcc reindex before every fuzzy lookup !

Thanks all
Re: Dtsx and Fuzzy Lookup Bug ? glovemtb
1/31/2007 7:00:15 AM
I think, but am still fuzzy (sorry) with the new tool to be sure that
this could be the issue.
Form help:
"The Fuzzy Lookup transformation creates a working copy of the
reference table. The indexes described below are created on this
working table by using a special table, not an ordinary SQL Server
index. The transformation does not modify the existing source tables
unless you select Maintain stored index. In this case, it creates a
trigger on the reference table that updates the working table and the
lookup index table based on changes to the reference table."
Re: Dtsx and Fuzzy Lookup Bug ? Allan Mitchell
2/2/2007 11:32:51 PM
You wouldn't need to reindex the table.

Ok so I have seen this also in the standard Lookup. Have you tried
playing with the WarmCaches and Exhaustive properties?

--


Allan Mitchell
http://wiki.sqlis.com | http://www.sqlis.com | http://www.sqldts.com |
http://www.konesans.com



[quoted text, click to view]
Re: Dtsx and Fuzzy Lookup Bug ? glovemtb
2/3/2007 6:43:36 AM
[quoted text, click to view]
Thanks for the reply. I've unit tested my lil sample as well as the
datacleaning.dtsx quite a bit.
I have found no ryme or reason for this odd behaviour of sometimes
just not using a reference record. Actually, it will pick up some new
records I put in and others it will not.
(Even though _similarity_ match should be 1 ).
Thanks, I will try playing with the warmchaches and exhaustive
properties.
I'm begining to think the ETI (Error Tolerant Index) is a little too
tolerant of design bugs.
But, morale of the story for me is as always do exhaustive data
analysis of the tools just as if you had written the code yourself.
Reminds me years ago when Sql Replication would just forget rows it
was supposed to replicate sometimes.....I did a pretty good review
with profiler and odbc trace of what was going on with that one and it
just turned out to be a years old bug err....design feature of certain
types of meta data.



Re: Dtsx and Fuzzy Lookup Bug ? glovemtb
2/6/2007 6:06:28 AM
Still no luck for me with that issue, but with this product eval I
need to move on. I have to say I was pissed at microsoft for taking
DTS interface out of SS 2005 Enterprise Manager (Even though you can
see that MS Sql Server Mgmt Studio is just a customized implementation
of the v studio IDE. )
But, I have to say DTSX is packed with features. Such as no more
forcing a runtime error to step into the debugger in the scripting
task as with ss 2000. Just easily stepping into DTS Scripting task in
the vstudio ide, (even though I can only seem to code in vb script
err. I mean vb2005.) I would think it would be fairly easy to "shell"
a c# implentation since they are allready in vstudio.
Anyway, really great new object model and interface modality for DTS.


AddThis Social Bookmark Button