all groups > sql server full text search > march 2006 >
You're in the

sql server full text search

group:

full text indexing opening many connections



full text indexing opening many connections Karel
3/2/2006 7:47:27 AM
sql server full text search: i created a job that performs indexing. the execution time takes only a
second. i noticed, however, using SQL Profiler that the process opened 32
connections!

trace details....

EventClass: Audit Login
ApplicationName: PKM
NTUserName: System
LoginName: NT AUTHORITY\SYSTEM


Re: full text indexing opening many connections Karel
3/2/2006 8:42:52 AM
One of my web applications threw the exception:

Timeout expired. The timeout period elapsed prior to obtaining a connection
from the pool. This may have occurred because all pooled connections were in
use and max pool size was reached.

After an investigation I found no errors in the web application that could
cause it use more than one sql connection, and i discovered that the indexing
process, which swallowed up many connections, took place at the very instant
of the error. I am suspecting that the max connections was reached as a
result of the full text indexing process.

[quoted text, click to view]
Re: full text indexing opening many connections Hilary Cotter
3/2/2006 11:19:01 AM
Why do you think it is unacceptable?

SQL FTS spawns many threads to grab as much data as possible simultaneously
to make indexing happen as fast as possible.

--
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.

This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

Re: full text indexing opening many connections Karel
3/2/2006 11:39:43 AM
Yeah, i understand what you just said. I'm not accusing the fulltext process
of tapping into the web app's connection. As far as i know, thats just not
possible. The problem im having is that the full text indexing process eats
up all available connections, not allowing anything else to connect.

Here is the scenario:
1. begin fulltext process: exec sp_fulltext_catalog N'Category', N'start_full'
2. in query analyzer execute: sp_who2 (view the fulltext process using 50+
connections)
3. start the webapp: hit the website and trigger a sql connection.

result: The web app can't connect. why? because the fulltext process used up
all of the connections! The web application then times out and throws the
exception.



[quoted text, click to view]
Re: full text indexing opening many connections Hilary Cotter
3/2/2006 12:49:19 PM
PKM uses a different connection pool. It won't exhaust your web application
connection pool.

--
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.

This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

Re: full text indexing opening many connections Simon Sabin
4/26/2006 12:00:00 AM
This is the way Full text works to index the data

Why is it unaccepatble?

The call to start indexing is an asynchronous call. i.e. it will finish before
the indexing has been finished.

[quoted text, click to view]

Re: full text indexing opening many connections Simon Sabin
4/26/2006 12:00:00 AM
Hello Karel,

It suggest that the server is hitting a limit of some sort either, network,
processor, memory or disk. It won't be connections because SQL can have thousands
of connections.

What is the spec of your box?

Do you have the full text indexes on a seperate drive.

[quoted text, click to view]

AddThis Social Bookmark Button