| Groups | Blog | Home |
sql server full text search : General Search Strategy Advice
really depends on whether you are joining them against relational tables whether you should store them in the database or not. Indexing Services isn't as scalable as SQL FTS, the boundary occurs somewhere between 1 million and 3 million documents. -- Hilary Cotter Looking for a SQL Server replication book? http://www.nwsu.com/0974973602.html Looking for a FAQ on Indexing Services/SQL FTS http://www.indexserverfaq.com [quoted text, click to view] "Larry Neylon" <larry@senior.removethis.co.uk> wrote in message news:%23Tof2rkPHHA.3268@TK2MSFTNGP03.phx.gbl... > Hi there, > > I'm looking for some advice on the best methods / tools to implement an > intranet search facility using ASP.NET and SQL2005. > > I need the ability to search both SQL Server content and files stored on > the web servers file system (.doc, .xls, .pdf, etc). > > Is there one tool that will perform both of these tasks for me, or am I > going to have to use a combination of fulltext search on the DB and Index > Server ? > > I know I can store the files in the DB and use and IFilter to search the > contents, but if possible I'd want to keep the files in the file system > rather than move them all into the DB. > > Any pointers would be most appreciated. > > Regards, > Larry. >
Hi there,
I'm looking for some advice on the best methods / tools to implement an intranet search facility using ASP.NET and SQL2005. I need the ability to search both SQL Server content and files stored on the web servers file system (.doc, .xls, .pdf, etc). Is there one tool that will perform both of these tasks for me, or am I going to have to use a combination of fulltext search on the DB and Index Server ? I know I can store the files in the DB and use and IFilter to search the contents, but if possible I'd want to keep the files in the file system rather than move them all into the DB. Any pointers would be most appreciated. Regards, Larry.
Hi Larry,
You may try doing: 1. Using the index server on one hand as filesystem indexing tool and read the result from SQLServer. To do this you must create a Linked server (from your sql server) pointing to your indexing server. And read the data from FileSystem with OPENQUERY (with select .... sqlserver style) 2. Have a table with a varbinary column where you can upload the files and index their content / based on the extension. HPH, xk [quoted text, click to view] Larry Neylon wrote:
> Hi there, > > I'm looking for some advice on the best methods / tools to implement an > intranet search facility using ASP.NET and SQL2005. > > I need the ability to search both SQL Server content and files stored on the > web servers file system (.doc, .xls, .pdf, etc). > > Is there one tool that will perform both of these tasks for me, or am I > going to have to use a combination of fulltext search on the DB and Index > Server ? > > I know I can store the files in the DB and use and IFilter to search the > contents, but if possible I'd want to keep the files in the file system > rather than move them all into the DB. > > Any pointers would be most appreciated. > > Regards, > Larry.
Using a linked server to Indexing Services (Index Server was an NT 4.0
Product) is simply not scalable. -- Hilary Cotter Looking for a SQL Server replication book? http://www.nwsu.com/0974973602.html Looking for a FAQ on Indexing Services/SQL FTS http://www.indexserverfaq.com [quoted text, click to view] <xkeops@gmail.com> wrote in message news:1169522997.951862.308800@q2g2000cwa.googlegroups.com... > Hi Larry, > > You may try doing: > 1. Using the index server on one hand as filesystem indexing tool and > read the result from SQLServer. To do this you must create a Linked > server (from your sql server) pointing to your indexing server. > And read the data from FileSystem with OPENQUERY (with select .... > sqlserver style) > 2. Have a table with a varbinary column where you can upload the files > and index their content / based on the extension. > > > HPH, > > xk > > > > Larry Neylon wrote: >> Hi there, >> >> I'm looking for some advice on the best methods / tools to implement an >> intranet search facility using ASP.NET and SQL2005. >> >> I need the ability to search both SQL Server content and files stored on >> the >> web servers file system (.doc, .xls, .pdf, etc). >> >> Is there one tool that will perform both of these tasks for me, or am I >> going to have to use a combination of fulltext search on the DB and Index >> Server ? >> >> I know I can store the files in the DB and use and IFilter to search the >> contents, but if possible I'd want to keep the files in the file system >> rather than move them all into the DB. >> >> Any pointers would be most appreciated. >> >> Regards, >> Larry. >
Definitely, especially if you are querying them relationally. However,
returning them from the file system especially through a web server which is optimized for returning documents offers better performance than returning them through the db. Also if you store up to 100 documents per subdirectory and nest all subdirectories in groups of 100 you get optimal file system performance. -- Hilary Cotter Looking for a SQL Server replication book? http://www.nwsu.com/0974973602.html Looking for a FAQ on Indexing Services/SQL FTS http://www.indexserverfaq.com [quoted text, click to view] "Larry Neylon" <larry@senior.removethis.co.uk> wrote in message news:umJQJswPHHA.4280@TK2MSFTNGP02.phx.gbl... > Thanks for that Hilary, > > Do you think actually storing the documents in SQL FTS would provide the > best performance ? > > Are there any 3rd party tools that anyone knows about ? > > Regards, > Larry. > "Hilary Cotter" <hilary.cotter@gmail.com> wrote in message > news:Oic3gquPHHA.4296@TK2MSFTNGP05.phx.gbl... >> Using a linked server to Indexing Services (Index Server was an NT 4.0 >> Product) is simply not scalable. >> >> -- >> Hilary Cotter >> >> Looking for a SQL Server replication book? >> http://www.nwsu.com/0974973602.html >> >> Looking for a FAQ on Indexing Services/SQL FTS >> http://www.indexserverfaq.com >> >> >> >> <xkeops@gmail.com> wrote in message >> news:1169522997.951862.308800@q2g2000cwa.googlegroups.com... >>> Hi Larry, >>> >>> You may try doing: >>> 1. Using the index server on one hand as filesystem indexing tool and >>> read the result from SQLServer. To do this you must create a Linked >>> server (from your sql server) pointing to your indexing server. >>> And read the data from FileSystem with OPENQUERY (with select .... >>> sqlserver style) >>> 2. Have a table with a varbinary column where you can upload the files >>> and index their content / based on the extension. >>> >>> >>> HPH, >>> >>> xk >>> >>> >>> >>> Larry Neylon wrote: >>>> Hi there, >>>> >>>> I'm looking for some advice on the best methods / tools to implement an >>>> intranet search facility using ASP.NET and SQL2005. >>>> >>>> I need the ability to search both SQL Server content and files stored >>>> on the >>>> web servers file system (.doc, .xls, .pdf, etc). >>>> >>>> Is there one tool that will perform both of these tasks for me, or am I >>>> going to have to use a combination of fulltext search on the DB and >>>> Index >>>> Server ? >>>> >>>> I know I can store the files in the DB and use and IFilter to search >>>> the >>>> contents, but if possible I'd want to keep the files in the file system >>>> rather than move them all into the DB. >>>> >>>> Any pointers would be most appreciated. >>>> >>>> Regards, >>>> Larry. >>> >> >> > >
Thanks for that Hilary,
Do you think actually storing the documents in SQL FTS would provide the best performance ? Are there any 3rd party tools that anyone knows about ? Regards, Larry. [quoted text, click to view] "Hilary Cotter" <hilary.cotter@gmail.com> wrote in message news:Oic3gquPHHA.4296@TK2MSFTNGP05.phx.gbl... > Using a linked server to Indexing Services (Index Server was an NT 4.0 > Product) is simply not scalable. > > -- > Hilary Cotter > > Looking for a SQL Server replication book? > http://www.nwsu.com/0974973602.html > > Looking for a FAQ on Indexing Services/SQL FTS > http://www.indexserverfaq.com > > > > <xkeops@gmail.com> wrote in message > news:1169522997.951862.308800@q2g2000cwa.googlegroups.com... >> Hi Larry, >> >> You may try doing: >> 1. Using the index server on one hand as filesystem indexing tool and >> read the result from SQLServer. To do this you must create a Linked >> server (from your sql server) pointing to your indexing server. >> And read the data from FileSystem with OPENQUERY (with select .... >> sqlserver style) >> 2. Have a table with a varbinary column where you can upload the files >> and index their content / based on the extension. >> >> >> HPH, >> >> xk >> >> >> >> Larry Neylon wrote: >>> Hi there, >>> >>> I'm looking for some advice on the best methods / tools to implement an >>> intranet search facility using ASP.NET and SQL2005. >>> >>> I need the ability to search both SQL Server content and files stored on >>> the >>> web servers file system (.doc, .xls, .pdf, etc). >>> >>> Is there one tool that will perform both of these tasks for me, or am I >>> going to have to use a combination of fulltext search on the DB and >>> Index >>> Server ? >>> >>> I know I can store the files in the DB and use and IFilter to search the >>> contents, but if possible I'd want to keep the files in the file system >>> rather than move them all into the DB. >>> >>> Any pointers would be most appreciated. >>> >>> Regards, >>> Larry. >> > >
Thanks Hilary,
There's enough there for me to be working on for now. Regards, Larry. [quoted text, click to view] "Hilary Cotter" <hilary.cotter@gmail.com> wrote in message news:%23rbfchxPHHA.4824@TK2MSFTNGP02.phx.gbl... > Definitely, especially if you are querying them relationally. However, > returning them from the file system especially through a web server which > is optimized for returning documents offers better performance than > returning them through the db. > > Also if you store up to 100 documents per subdirectory and nest all > subdirectories in groups of 100 you get optimal file system performance. > > -- > Hilary Cotter > > Looking for a SQL Server replication book? > http://www.nwsu.com/0974973602.html > > Looking for a FAQ on Indexing Services/SQL FTS > http://www.indexserverfaq.com > > > > "Larry Neylon" <larry@senior.removethis.co.uk> wrote in message > news:umJQJswPHHA.4280@TK2MSFTNGP02.phx.gbl... >> Thanks for that Hilary, >> >> Do you think actually storing the documents in SQL FTS would provide the >> best performance ? >> >> Are there any 3rd party tools that anyone knows about ? >> >> Regards, >> Larry. >> "Hilary Cotter" <hilary.cotter@gmail.com> wrote in message >> news:Oic3gquPHHA.4296@TK2MSFTNGP05.phx.gbl... >>> Using a linked server to Indexing Services (Index Server was an NT 4.0 >>> Product) is simply not scalable. >>> >>> -- >>> Hilary Cotter >>> >>> Looking for a SQL Server replication book? >>> http://www.nwsu.com/0974973602.html >>> >>> Looking for a FAQ on Indexing Services/SQL FTS >>> http://www.indexserverfaq.com >>> >>> >>> >>> <xkeops@gmail.com> wrote in message >>> news:1169522997.951862.308800@q2g2000cwa.googlegroups.com... >>>> Hi Larry, >>>> >>>> You may try doing: >>>> 1. Using the index server on one hand as filesystem indexing tool and >>>> read the result from SQLServer. To do this you must create a Linked >>>> server (from your sql server) pointing to your indexing server. >>>> And read the data from FileSystem with OPENQUERY (with select .... >>>> sqlserver style) >>>> 2. Have a table with a varbinary column where you can upload the files >>>> and index their content / based on the extension. >>>> >>>> >>>> HPH, >>>> >>>> xk >>>> >>>> >>>> >>>> Larry Neylon wrote: >>>>> Hi there, >>>>> >>>>> I'm looking for some advice on the best methods / tools to implement >>>>> an >>>>> intranet search facility using ASP.NET and SQL2005. >>>>> >>>>> I need the ability to search both SQL Server content and files stored >>>>> on the >>>>> web servers file system (.doc, .xls, .pdf, etc). >>>>> >>>>> Is there one tool that will perform both of these tasks for me, or am >>>>> I >>>>> going to have to use a combination of fulltext search on the DB and >>>>> Index >>>>> Server ? >>>>> >>>>> I know I can store the files in the DB and use and IFilter to search >>>>> the >>>>> contents, but if possible I'd want to keep the files in the file >>>>> system >>>>> rather than move them all into the DB. >>>>> >>>>> Any pointers would be most appreciated. >>>>> >>>>> Regards, >>>>> Larry. >>>> >>> >>> >> >> > >
Hello Larry,
I breifly looked at SQL Turbo last year and was impressed. It allows the filename to be stored in the DB rather than the whole document. It could be worth a try. Simon Sabin SQL Server MVP http://sqlblogcasts.com/blogs/simons [quoted text, click to view] > Thanks for that Hilary, > > Do you think actually storing the documents in SQL FTS would provide > the best performance ? > > Are there any 3rd party tools that anyone knows about ? > > Regards, > Larry. > "Hilary Cotter" <hilary.cotter@gmail.com> wrote in message > news:Oic3gquPHHA.4296@TK2MSFTNGP05.phx.gbl... >> Using a linked server to Indexing Services (Index Server was an NT >> 4.0 Product) is simply not scalable. >> >> -- Hilary Cotter >> >> Looking for a SQL Server replication book? >> http://www.nwsu.com/0974973602.html >> Looking for a FAQ on Indexing Services/SQL FTS >> http://www.indexserverfaq.com >> <xkeops@gmail.com> wrote in message >> news:1169522997.951862.308800@q2g2000cwa.googlegroups.com... >> >>> Hi Larry, >>> >>> You may try doing: >>> 1. Using the index server on one hand as filesystem indexing tool >>> and >>> read the result from SQLServer. To do this you must create a Linked >>> server (from your sql server) pointing to your indexing server. >>> And read the data from FileSystem with OPENQUERY (with select .... >>> sqlserver style) >>> 2. Have a table with a varbinary column where you can upload the >>> files >>> and index their content / based on the extension. >>> HPH, >>> >>> xk >>> >>> Larry Neylon wrote: >>> >>>> Hi there, >>>> >>>> I'm looking for some advice on the best methods / tools to >>>> implement an intranet search facility using ASP.NET and SQL2005. >>>> >>>> I need the ability to search both SQL Server content and files >>>> stored on >>>> the >>>> web servers file system (.doc, .xls, .pdf, etc). >>>> Is there one tool that will perform both of these tasks for me, or >>>> am I >>>> going to have to use a combination of fulltext search on the DB and >>>> Index >>>> Server ? >>>> I know I can store the files in the DB and use and IFilter to >>>> search the contents, but if possible I'd want to keep the files in >>>> the file system rather than move them all into the DB. >>>> >>>> Any pointers would be most appreciated. >>>> >>>> Regards, >>>> Larry.
Don't see what you're looking for? Try a search.
|
June 2003
July 2003
August 2003
September 2003
October 2003
November 2003
December 2003
January 2004
February 2004
March 2004
April 2004
May 2004
June 2004
July 2004
August 2004
September 2004
October 2004
November 2004
December 2004
January 2005
February 2005
March 2005
April 2005
May 2005
June 2005
July 2005
August 2005
September 2005
October 2005
November 2005
December 2005
January 2006
February 2006
March 2006
April 2006
May 2006
June 2006
July 2006
August 2006
September 2006
October 2006
November 2006
December 2006
January 2007
February 2007
March 2007
April 2007
May 2007
June 2007
July 2007
August 2007
September 2007
October 2007
November 2007
| home · blog · groups | Questions? Comments? Contact the dn |