Hi there
We have a production server with a wcf service published on IIS 6.0 running over a windows 2003 server
We are having several problems because the w3wp.exe seems to fault randomly giving a application log entry like this:
"Faulting application w3wp.exe, version 6.0.3790.3959, stamp 45d6968e, faulting module kernel32.dll, version 5.2.3790.4062, stamp 462646c6, debug? 0, fault address 0x0000bee7."
When this error gets more than 5 times in 5 minutes, the application pool is disabled, shutting down the service to our clients.
We are debugged our code looking for non catched exceptions or malfunctioning code, have fixed some issues but the system keeps going bad.
We are used iisstate to debug the processess but the logs gets some crc errors on some .net dlls, we are reinstaled framework, but that does not correct anything
I paste the log from iisstate,
Has anyone any useful idea?? any comments will be appreciated
Vilo
Opened log file 'R:\mfIns\Utilidades\IISState\output\IISState-696.log'
***********************
Starting new log output
IISState version 3.3.1
Sat Apr 04 17:51:43 2009
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 696
Note: Thread times are formatted as HH:MM:SS.ms
***********************
IIS has crashed...
Beginning Analysis
DLL (!FunctionName) that failed:
Thread ID: 36
System Thread ID: 230
Kernel Time: 0:0:3.31
User Time: 0:1:29.250
*** WARNING: Unable to verify checksum for C:\WINDOWS\assembly\NativeImages_v2.0.50727_32\System.ServiceModel\4146033013edebd7e0cb604e504ebfee\System.ServiceModel.ni.dll
*** WARNING: Unable to verify checksum for C:\WINDOWS\assembly\NativeImages_v2.0.50727_32\SMDiagnostics\9790551187e294b4ed3aaa1c221891c7\SMDiagnostics.ni.dll
*** WARNING: Unable to verify checksum for C:\WINDOWS\assembly\NativeImages_v2.0.50727_32\mscorlib\6d667f19d687361886990f3ca0f49816\mscorlib.ni.dll
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
failed to load from resource.Failed to load SOS data.
No valid SOS data table found.
Begin System Thread Information
# ChildEBP RetAddr
WARNING: Frame IP not in any known module. Following frames may be wrong.
00 00e1ea84 1d6d136e 0x1d6d1932
01 00e1eacc 1d3f0ee6 0x1d6d136e
02 00e1eb10 1d400168 0x1d3f0ee6
03 00e1eb2c 1b0c0d58 0x1d400168
04 00e1ebe0 1b0bef72 System_ServiceModel_ni+0x310d58
05 00e1ec3c 1b0beae3 System_ServiceModel_ni+0x30ef72
06 00e1ec74 1b0bea00 System_ServiceModel_ni+0x30eae3
07 00e1eca0 1b0be966 System_ServiceModel_ni+0x30ea00
08 00e1ecb4 1b0be743 System_ServiceModel_ni+0x30e966
09 00e1ecc8 1b0bdec7 System_ServiceModel_ni+0x30e743
0a 00e1ece8 1b0bdc0b System_ServiceModel_ni+0x30dec7
0b 00e1ed2c 1b0bdb5d System_ServiceModel_ni+0x30dc0b
0c 00e1eedc 1b0bc55f System_ServiceModel_ni+0x30db5d
0d 00e1ef14 1b0bc2a3 System_ServiceModel_ni+0x30c55f
0e 00e1ef30 1b0bc254 System_ServiceModel_ni+0x30c2a3
0f 00e1ef40 1bece746 System_ServiceModel_ni+0x30c254
10 00e1ef6c 1b0afcd8 SMDiagnostics_ni+0xe746
11 00e1efa8 1b0bb2e8 System_ServiceModel_ni+0x2ffcd8
12 00e1efb8 1b0b2f54 System_ServiceModel_ni+0x30b2e8
13 00e1f018 1b12d707 System_ServiceModel_ni+0x302f54
14 00e1f044 1b12d77b System_ServiceModel_ni+0x37d707
15 00e1f060 1b12d39c System_ServiceModel_ni+0x37d77b
16 00e1f084 1b12cecf System_ServiceModel_ni+0x37d39c
17 00e1f0cc 1b0cd8a1 System_ServiceModel_ni+0x37cecf
18 00e1f124 1b0cc374 System_ServiceModel_ni+0x31d8a1
19 00e1f140 1b0cc157 System_ServiceModel_ni+0x31c374
1a 00e1f17c 1b0cc0f9 System_ServiceModel_ni+0x31c157
1b 00e1f1a8 1b0c39a6 System_ServiceModel_ni+0x31c0f9
1c 00e1f1e8 1b0c38e7 System_ServiceModel_ni+0x3139a6
1d 00e1f1fc 1b0c3890 System_ServiceModel_ni+0x3138e7
1e 00e1f230 1b0c36ea System_ServiceModel_ni+0x313890
1f 00e1f25c 1b0c365f System_ServiceModel_ni+0x3136ea
20 00e1f294 7928cdc4 System_ServiceModel_ni+0x31365f
21 00e1f2b8 79e71b4c mscorlib_ni+0x1ccdc4
22 00e1f2cc 79e821f9 mscorwks+0x1b4c
23 00e1f34c 79e8285f mscorwks+0x121f9
24 00e1f36c 79e828a0 mscorwks+0x1285f
25 00e1f3d0 79e82911 mscorwks+0x128a0
26 00e1f404 7a0b692f mscorwks+0x12911
27 00e1f470 79e984cf mscorwks+0x24692f
28 00e1f484 79e9846b mscorwks+0x284cf
29 00e1f518 79e98391 mscorwks+0x2846b
2a 00e1f554 79fd880a mscorwks+0x28391
2b 00e1f564 79fd9799 mscorwks+0x16880a
2c 00e1f614 79fd882b mscorwks+0x169799
2d 00e1f630 79e9846b mscorwks+0x16882b
2e 00e1f6c4 79e98391 mscorwks+0x2846b
2f 00e1f700 79e9851d mscorwks+0x28391
30 00e1f728 79fd8f6c mscorwks+0x2851d
31 00e1f740 7a0b6b5b mscorwks+0x168f6c
Closing open log file R:\mfIns\Utilidades\IISState\output\IISState-696.log
Opened log file 'R:\mfIns\Utilidades\IISState\output\IISState-696.log'
***********************
Starting new log output
IISState version 3.3.1
Sat Apr 04 19:08:20 2009
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 696
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: bc0
Kernel Time: 0:0:0.31
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0006fc08 7c827d0b ntdll!KiFastSystemCallRet
01 0006fc0c 77e41d1e ntdll!NtWaitForSingleObject+0xc
02 0006fc7c 77e41c8d kernel32!WaitForSingleObjectEx+0xac
03 0006fc90 5a4a4662 kernel32!WaitForSingleObject+0x12
04 0006fca0 5a4a6e3f w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
05 0006fca8 5a4ef42d w3dt!UlAtqStartListen+0x2d
06 0006fcb8 5a4fc335 w3core!W3_SERVER::StartListen+0xbd
07 0006ff0c 0100187c w3core!UlW3Start+0x26e
08 0006ff44 01001a27 w3wp!wmain+0x22a
09 0006ffc0 77e4f23b w3wp!wmainCRTStartup+0x12f
0a 0006fff0 00000000 kernel32!BaseProcessStart+0x23
Thread ID: 1
System Thread ID: 1100
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00d2ff9c 7c826f4b ntdll!KiFastSystemCallRet
01 00d2ffa0 7c83d424 ntdll!NtDelayExecution+0xc
02 00d2ffb8 77e44829 ntdll!RtlpTimerThread+0x47
03 00d2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 2
System Thread ID: 1234
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00fdff24 7c8277db ntdll!KiFastSystemCallRet
01 00fdff28 77e3bea2 ntdll!ZwRemoveIoCompletion+0xc
02 00fdff54 5a44248e kernel32!GetQueuedCompletionStatus+0x29
03 00fdff8c 5a4426ac W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00fdffa0 5a441da9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00fdffb8 77e44829 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00fdffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 3
System Thread ID: 10e4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0104ff24 7c8277db ntdll!KiFastSystemCallRet
01 0104ff28 77e3bea2 ntdll!ZwRemoveIoCompletion+0xc
02 0104ff54 5a44248e kernel32!GetQueuedCompletionStatus+0x29
