Groups | Blog | Home
all groups > sql server full text search > august 2004 >

sql server full text search : neutral/english search



John Kane
8/18/2004 8:27:03 AM
Guy,
For SQL Server 2000, the best tactic is to separate the text that is now
being searched in one column with multiple languages into two or more
(depending upon the number of languages) columns and then defining the
correct language wordbreaker for the text in each column. Once this is done,
you can direct your users who run non-English FTS queries to their
non-English specific language content, and the English-only users to their
English content using the US or UK wordbreaker and enjoy the
stemming/breaking of the English wordbreakers....

However, in SQL Server 2005 (codename Yukon & currently in early beta), you
will be able to issue language specific SQL FTS queries to a single column
that contains multiple languages, for example:

-- using the English language
SELECT * FROM FTS_Table
WHERE CONTAINS(FtCol1, 'John', LANGUAGE 'English')

-- using the Spanish language
SELECT * FROM FTS_Table
WHERE CONTAINS(FtCol1, 'Juan', LANGUAGE 'Spanish')

Regards,
John


[quoted text, click to view]

Guy Brom
8/18/2004 3:34:01 PM
I have a searchable fulltext column.that has multilingual content in it.

Some users run a non-English query, while most run English-only queries.

What's the best tactic to make the non-English/multilingual queries to be
run against a neutral catalog (like it is now), while making the
English-only queries enjoy the stemming/breaking of the English word
breaker?

Using SQL2K, Standard

Guy Brom
8/18/2004 7:38:54 PM
Thanks John. I figured out this is the only solution.

I'm wondering - do you know of any SQL function or process that might help
me achive a check for English-only strings? this way I can move the code
from the application tier into the same sql sp that uses fts.



[quoted text, click to view]

John Kane
8/18/2004 9:41:34 PM
You're welcome, Guy,
Yes, I believe I do. However, it depends upon what languages other than
English you have in your single text column.
Could you post a list of language you have in your column?

Thanks,
John



[quoted text, click to view]

Guy Brom
8/19/2004 11:39:43 AM
John hi,

I have lots (about 8). wouldn't it be better to filter by English-only
characters rather then non-English?


[quoted text, click to view]

John Kane
8/23/2004 9:08:18 AM
Guy,
I've emailed your yahoo account with possible (under development) methods
for this.

John



[quoted text, click to view]

Guy Brom
8/23/2004 2:20:16 PM
John Hi,

Any news about a method to seperate English-only searches?

Thanks!

[quoted text, click to view]

AddThis Social Bookmark Button