all groups > sql server full text search > march 2007 >
You're in the

sql server full text search

group:

Can I delete the gather logs?



Can I delete the gather logs? Optiontrader1138
3/16/2007 10:26:13 AM
sql server full text search: The gather logs are huge, full of mostly "success" messages, and are
massively slowing down our FT population time. Can I safely delete
them?
Re: Can I delete the gather logs? Optiontrader1138
3/16/2007 11:25:09 AM
It was already zero ...


[quoted text, click to view]

Re: Can I delete the gather logs? Optiontrader1138
3/16/2007 11:33:35 AM
I stopped the FT service, deleted the main gather log and created an
empty file with the same filename. I then restarted the FT service. It
should've started where it left off, but it doesn't appear that's
happening.

The catalog was initially "idle", which I don't understand. It is set
to "change tracking in background", so I would have assumed it would
start automatically. But it didn't. I kicked off an incremental
population, and it appears that it's started over from the beginning.
In Perf Monitor, the "documents filtered" monitor is currently 0,
while "Waiting documents" is steadily climbing. The new gather file is
already at 627Mb and climbing.

This doesn't seem right. Any ideas?


On Mar 16, 12:25 pm, "Optiontrader1138" <seoconsultan...@gmail.com>
[quoted text, click to view]

Re: Can I delete the gather logs? Optiontrader1138
3/16/2007 12:03:10 PM
As much as I would love to send you the gather log, it is currently
1.17 Gb, so I don't think you'd appreciate me sending it!

"Change tracking in background" is still on. I checked the table and
it definitely was not finished populating when it was idle ... 90% of
the DB was still not indexed and was not showing up in my test
queries.

I think part of the confusion may be that the registry key that you
mentioned may only affect the notifier gather log (in my case, named
SQL0001200005.Ntfy1.gthr). This logfile is only 1k. The 1.17Gb file is
named SQL0001200005.Crwl2.gthr. This is just based on what I've been
able to google so far - let me know if I'm way off-base.

Thanks!!

[quoted text, click to view]

Re: Can I delete the gather logs? Optiontrader1138
3/16/2007 12:33:57 PM
Sure - here it is:

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005]
"LogDirectory"="E:\\SQLData\\SQL0001200005"
"StreamLogsDirectory"="D:\\Program Files\\Microsoft SQL Server\\MSSQL\
\FTData\\SQLServer\\GatherLogs"
"LogName"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Ntfy1.gthr"
"LogNumber"=dword:00000001
"NotificationLogCheckPoint"=hex:80,00,00,00,00,00,00,00
"HistoryHashMapFile"="E:\\SQLData\\SQL0001200005\
\SQL0001200005.Hash.gthr"
"DocIdMapFile"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Idm.gthr"
"NewCrawlNumber"=dword:00000003
"LogSuccess"=dword:00000000
"FollowComplexUrls"=dword:00000000
"DisableRecovery"=dword:00000000
"DisableRobotsExclusion"=dword:00000000
"NormalizeUrls"=dword:00000001
"CaseSensitiveUrls"=dword:00000000
"UseIncrementalCrawlDirIter"=dword:00000000
"ACContentSync"=dword:0000005a
"ACRejects"=dword:00000000
"ACTotal"=dword:00000000
"ACErrorEst"=dword:ffffffff
"ACErrors"=dword:00000000
"ACErrorSamples"=dword:00000000
"ACMaxNoAccess"=dword:00127500
"FilterAlways"=dword:00000000
"LazyCheckPointUpdateInterval"=dword:00015180
"EnableCheckPoint"=dword:00000000
"ACActiveProfile"=hex:ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,ed,58,81,\
3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,\
ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,ed,\
58,81,3c,ed,58,81,3c,33,33,33,3f,
00,00,00,00,00,00,00,00,00,00,00,00,00,00,\
00,00,00,00,00,00
"ACTrainingProfile"=hex:c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,\

29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,\

34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,\
c6,89,29,34,c6,89,29,34,8a,e1,ea,
36,00,00,00,00,00,00,00,00,00,00,00,00,00,\
00,00,00,00,00,00,00
"LogExcluded"=dword:00000000
"LogDisabled"=dword:00000000
"ForceFullCrawl"=dword:00000000
"PausedExternal"=dword:00000000

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Crawls]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Crawls\2]
"CrawlType"=dword:00000002
"InProgress"=dword:00000001
"DoneAddingCrawlSeeds"=dword:00000001
"LogName"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Crwl2.gthr"
"CheckPoint"=hex:80,00,00,00,00,00,00,00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Extensions]
"IncludedExtensions"=dword:00000001

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Extensions\ExtensionList]
"0"="htm"
"1"="html"
"2"="txt"
"3"="asp"
"4"="xls"
"5"="doc"
"6"="ppt"
"7"="exch"
"8"="xml"
"9"="eml"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Mappings]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\File]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\File\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.FileHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\Http]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\Http\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.HttpHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="sqlfth75.sqlfth75.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\OleDb]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\OleDb\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.OleDbHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Sites]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StartPages]
"NewStartPageIdentifier"=dword:00000001

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StartPages\0]
"URL"="MSSQL75://SQLServer/77bfcb91"
"HostDepth"=dword:00000000
"EnumerationDepth"=dword:ffffffff
"FollowDirectories"=dword:00000001
"StartPageIdentifier"=dword:00000000
"CrawlNumberInProgress"=dword:00000002
"CrawlNumberScheduled"=dword:ffffffff
"ForceFullCrawl"=dword:00000000
"LastCrawlStopped"=dword:00000000
"Type"=dword:00000002
"CrawlControl"=dword:00000000
"LastCrawlType"=dword:00000002
"IncludeInProjectCrawls"=dword:00000001
"LastCrawlTime"=hex:86,05,c1,a7,f8,67,c7,01
"NotificationHRes"=dword:00000000

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StreamLog]
"CurrentStreamLog"=dword:00000004
"MaxLogs"=dword:00000005
"StreamLogCount"=dword:00000003

Re: Can I delete the gather logs? Hilary Cotter
3/16/2007 2:10:01 PM
Absolutely, but something is wrong here. I think you are in debug mode.

Have a look at the following key
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer\SQL0000800005
- replacing SQL0000800005 with your actual catalog name. Make sure the
value of the logsuccesses key is 0.

If it isn't set it to 0 and restart MSSearch.
--
Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

Re: Can I delete the gather logs? Hilary Cotter
3/16/2007 2:51:22 PM
You should have left it with change tracking. When it is idle it means it
has finished populating/indexing.

You did not need to re-create the gatherer log. I am still a little puzzled
as to why it is giving you all these status messages.

Could you attach the gatherer log here or email it to me offline. Don't post
it as it is hard for me to interpret all the hex.

--
Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

Re: Can I delete the gather logs? Hilary Cotter
3/16/2007 3:18:42 PM
Can you export the registry key for this catalog and post it here?

Do other catalog exhibit the same behavior?

--
Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

Re: Can I delete the gather logs? Hilary Cotter
3/16/2007 3:38:34 PM
It looks good. I am not sure what is going on, other than to say this looks
abnormal.

--
Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



[quoted text, click to view]

AddThis Social Bookmark Button