Running IIS6 and I have an Application Pool with 3 sites. Many times
throughout the day I get this error in the event log:
A process serving application pool 'High-Usage' suffered a fatal
communication error with the World Wide Web Publishing Service. The process
id was '6932'. The data field contains the error number.
...which I know is very generic and means the pool jsut simply crashed.
Here is an iisstate log if someone would not mind taking a look at it. Thanks
Opened log file 'C:\iisstate\output\IISState-4068.log'
***********************
Starting new log output
IISState version 3.3.1
Tue Jan 31 15:05:29 2006
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 4068
Note: Thread times are formatted as HH:MM:SS.ms
***********************
IIS has crashed...
Beginning Analysis
DLL (!FunctionName) that failed:
Thread ID: 61
System Thread ID: 1d68
Kernel Time: 0:0:0.46
User Time: 0:0:0.109
*** ERROR: Symbol file could not be found. Defaulted to export symbols for
C:\Program Files\Common Files\Crystal Decisions\2.5\bin\CEReportSource.dll -
*** WARNING: Unable to verify checksum for C:\WINDOWS\system32\cxlibw-1-6.dll
*** ERROR: Symbol file could not be found. Defaulted to export symbols for
C:\WINDOWS\system32\cxlibw-1-6.dll -
Thread Type: Idle ASP thread
# ChildEBP RetAddr
WARNING: Frame IP not in any known module. Following frames may be wrong.
00 067ee8ac 4246a80e 0x35
01 067ee8b8 424b05de CEReportSource!DllUnregisterServer+0x9505
02 067ee8d0 424b474f CEReportSource!DllUnregisterServer+0x4f2d5
03 067ee8dc 424b464d CEReportSource!DllUnregisterServer+0x53446
04 067ee8e8 424b2990 CEReportSource!DllUnregisterServer+0x53344
05 067ee8f8 424b257f CEReportSource!DllUnregisterServer+0x51687
06 067ee90c 424b2559 CEReportSource!DllUnregisterServer+0x51276
07 067ee920 424b1015 CEReportSource!DllUnregisterServer+0x51250
08 067ee940 424b0003 CEReportSource!DllUnregisterServer+0x4fd0c
09 067ee964 424afc6f CEReportSource!DllUnregisterServer+0x4ecfa
0a 067ee970 424af7db CEReportSource!DllUnregisterServer+0x4e966
0b 067ee97c 42517a15 CEReportSource!DllUnregisterServer+0x4e4d2
0c 067efa50 424af2af CEReportSource!DllUnregisterServer+0xb670c
0d 067efa5c 494583fd CEReportSource!DllUnregisterServer+0x4dfa6
0e 067efa70 4249fdfe cxlibw_1_6!CXLib106::CRefCount::release+0x2d
0f 067efa7c 424ab56c CEReportSource!DllUnregisterServer+0x3eaf5
10 067efa88 42461299 CEReportSource!DllUnregisterServer+0x4a263
11 067efa90 424ea363 CEReportSource+0x1299
12 067efab0 7c82257a CEReportSource!DllUnregisterServer+0x8905a
13 067efad0 7c818145 ntdll!LdrpCallInitRoutine+0x14
14 067efbe4 77e67b95 ntdll!LdrUnloadDll+0x40e
15 067efbf8 776b46fb kernel32!FreeLibrary+0x41
16 067efc04 776b470f
ole32!CClassCache::CDllPathEntry::CFinishObject::Finish+0x2f
17 067efc18 776b4c33 ole32!CClassCache::CFinishComposite::Finish+0x1d
18 067efd7c 776b4b89 ole32!CClassCache::FreeUnused+0x1bc
19 067efd8c 776b5137 ole32!CoFreeUnusedLibrariesEx+0x36
1a 067efd98 75bd78e3 ole32!CoFreeUnusedLibraries+0x9
1b 067efd9c 7739c3b7 comsvcs!STAFreeLibTimerProc+0x6
1c 067efdc8 77393147 USER32!InternalCallWinProc+0x28
1d 067efe40 7739ce45 USER32!UserCallWinProc+0xf4
1e 067efea0 7739c778 USER32!DispatchMessageWorker+0x138
1f 067efeb0 75bd7a78 USER32!DispatchMessageW+0xf
20 067efecc 75bd79a5 comsvcs!CSTAQueueLessMessageWork::DoWork+0x4e
21 067efee4 75bd833e comsvcs!CSTAThread::DoWork+0x18
22 067eff04 75bd878a comsvcs!CSTAThread::ProcessQueueWork+0x37
23 067eff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x17c
24 067effb8 77e66063 msvcrt!_endthreadex+0xa3
25 067effec 00000000 kernel32!BaseThreadStart+0x34
Closing open log file C:\iisstate\output\IISState-4068.log
Opened log file 'C:\iisstate\output\IISState-4068.log'
***********************
Starting new log output
IISState version 3.3.1
Tue Jan 31 15:05:55 2006
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 4068
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: 17d0
Kernel Time: 0:0:0.125
User Time: 0:0:0.125
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0007fc08 7c822124 ntdll!KiFastSystemCallRet
01 0007fc0c 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0007fc7c 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0007fc90 5a36467a kernel32!WaitForSingleObject+0x12
04 0007fca0 5a366e63 w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
05 0007fca8 5a3af41d w3dt!UlAtqStartListen+0x2d
06 0007fcb8 5a3bc259 w3core!W3_SERVER::StartListen+0xbd
07 0007ff0c 0100187c w3core!UlW3Start+0x26e
08 0007ff44 01001a23 w3wp!wmain+0x22a
09 0007ffc0 77e523cd w3wp!wmainCRTStartup+0x12b
0a 0007fff0 00000000 kernel32!BaseProcessStart+0x23
Thread ID: 1
System Thread ID: b20
Kernel Time: 0:0:0.375
User Time: 0:0:0.312
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 00abfdcc 7c822114 ntdll!KiFastSystemCallRet
01 00abfdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 00abfe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 00abfed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 00abfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 00abff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 00abffb8 77e66063 msvcrt!_endthreadex+0xa3
07 00abffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 2
System Thread ID: 1180
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00afff9c 7c821364 ntdll!KiFastSystemCallRet
01 00afffa0 7c81fe26 ntdll!NtDelayExecution+0xc
02 00afffb8 77e66063 ntdll!RtlpTimerThread+0x47
03 00afffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 3
System Thread ID: 1e04
Kernel Time: 0:0:0.312
User Time: 0:0:3.125
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0408fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0408fdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0408fe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 0408fed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0408fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0408ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0408ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 0408ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 4
System Thread ID: 1edc
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page
No remote call being made
# ChildEBP RetAddr
00 00bbfe18 7c821c54 ntdll!KiFastSystemCallRet
01 00bbfe1c 77c7538c ntdll!ZwReplyWaitReceivePortEx+0xc
02 00bbff84 77c5778f RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 00bbff8c 77c5f7dd RPCRT4!RecvLotsaCallsWrapper+0xd
04 00bbffac 77c5de88 RPCRT4!BaseCachedThreadRoutine+0x9d
05 00bbffb8 77e66063 RPCRT4!ThreadStartRoutine+0x1b
06 00bbffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 5
System Thread ID: 18f8
Kernel Time: 0:0:0.468
User Time: 0:0:1.328
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 019dfdcc 7c822114 ntdll!KiFastSystemCallRet
01 019dfdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 019dfe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 019dfed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 019dfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 019dff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 019dffb8 77e66063 msvcrt!_endthreadex+0xa3
07 019dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 6
System Thread ID: 1080
Kernel Time: 0:0:0.796
User Time: 0:0:0.343
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00dbff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00dbff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00dbff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00dbff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00dbffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00dbffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00dbffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 7
System Thread ID: af0
Kernel Time: 0:0:0.906
User Time: 0:0:0.171
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00dfff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00dfff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00dfff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00dfff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00dfffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00dfffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00dfffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 8
System Thread ID: 1380
Kernel Time: 0:0:1.250
User Time: 0:0:0.625
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00e3ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00e3ff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00e3ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00e3ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00e3ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00e3ffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00e3ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 9
System Thread ID: 108c
Kernel Time: 0:0:1.359
User Time: 0:0:0.453
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00e7ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00e7ff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00e7ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00e7ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00e7ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00e7ffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00e7ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 10
System Thread ID: 1a44
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00f6fcec 7c822114 ntdll!KiFastSystemCallRet
01 00f6fcf0 7c83acfd ntdll!NtWaitForMultipleObjects+0xc
02 00f6ffb8 77e66063 ntdll!RtlpWaitThread+0x161
03 00f6ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 11
System Thread ID: 814
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0191fa84 7c822124 ntdll!KiFastSystemCallRet
01 0191fa88 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0191faf8 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0191fb0c 5a3b8147 kernel32!WaitForSingleObject+0x12
04 0191ffb8 77e66063 w3core!HTTP_COMPRESSION::CompressionThread+0x126
05 0191ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 12
System Thread ID: 113c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page
No remote call being made
# ChildEBP RetAddr
00 0195fe18 7c821c54 ntdll!KiFastSystemCallRet
01 0195fe1c 77c7538c ntdll!ZwReplyWaitReceivePortEx+0xc
02 0195ff84 77c5778f RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 0195ff8c 77c5f7dd RPCRT4!RecvLotsaCallsWrapper+0xd
04 0195ffac 77c5de88 RPCRT4!BaseCachedThreadRoutine+0x9d
05 0195ffb8 77e66063 RPCRT4!ThreadStartRoutine+0x1b
06 0195ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 13
System Thread ID: a18
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0199ff8c 7c821364 ntdll!KiFastSystemCallRet
01 0199ff90 7c815267 ntdll!NtDelayExecution+0xc
02 0199ffb8 77e66063 ntdll!RtlpIOWorkerThread+0x3f
03 0199ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 14
System Thread ID: 11b8
Kernel Time: 0:0:0.437
User Time: 0:0:6.140
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03abfdcc 7c822114 ntdll!KiFastSystemCallRet
01 03abfdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 03abfe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 03abfed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03abfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03abff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03abffb8 77e66063 msvcrt!_endthreadex+0xa3
07 03abffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 15
System Thread ID: 1288
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 027bff0c 7c822124 ntdll!KiFastSystemCallRet
01 027bff10 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 027bff80 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 027bff94 709fc91b kernel32!WaitForSingleObject+0x12
04 027bffb4 709fc8f3 asp!CApplnCleanupMgr::ApplnCleanupDoWork+0x1e
05 027bffb8 77e66063 asp!CApplnCleanupMgr::ApplnCleanupThread+0xa
06 027bffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 16
System Thread ID: 1200
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 0287fe1c 7c822114 ntdll!KiFastSystemCallRet
01 0287fe20 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0287fec8 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 0287ff24 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0287ff40 709fbcbe USER32!MsgWaitForMultipleObjects+0x1f
05 0287ff84 77bcb530 asp!CMTACallbackThread::Thread+0x4f
06 0287ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 0287ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 17
System Thread ID: 1984
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 02fefef4 7c822124 ntdll!KiFastSystemCallRet
01 02fefef8 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 02feff68 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 02feff7c 709fe9b7 kernel32!WaitForSingleObject+0x12
04 02feffb8 77e66063 asp!CViperReqManager::WatchThread+0x68
05 02feffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 18
System Thread ID: 3a8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0307fee8 7c822124 ntdll!KiFastSystemCallRet
01 0307feec 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0307ff5c 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0307ff70 75bd4bd0 kernel32!WaitForSingleObject+0x12
04 0307ff84 77bcb530 comsvcs!CSTAThreadPool::LoadBalanceThreadControlLoop+0x29
05 0307ffb8 77e66063 msvcrt!_endthreadex+0xa3
06 0307ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 19
System Thread ID: 183c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 030bfee0 7c822124 ntdll!KiFastSystemCallRet
01 030bfee4 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 030bff54 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 030bff68 75bd464d kernel32!WaitForSingleObject+0x12
04 030bff84 77bcb530 comsvcs!CSTAThreadPool::KillThreadControlLoop+0x25
05 030bffb8 77e66063 msvcrt!_endthreadex+0xa3
06 030bffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 20
System Thread ID: 3f8
Kernel Time: 0:0:0.250
User Time: 0:0:0.156
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 030ffdcc 7c822114 ntdll!KiFastSystemCallRet
01 030ffdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 030ffe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 030ffed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 030ffef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 030fff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 030fffb8 77e66063 msvcrt!_endthreadex+0xa3
07 030fffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 21
System Thread ID: 1888
Kernel Time: 0:0:0.640
User Time: 0:0:1.875
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 031cfdcc 7c822114 ntdll!KiFastSystemCallRet
01 031cfdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 031cfe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 031cfed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 031cfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 031cff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 031cffb8 77e66063 msvcrt!_endthreadex+0xa3
07 031cffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 22
System Thread ID: 114
Kernel Time: 0:0:0.343
User Time: 0:0:1.671
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0323fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0323fdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0323fe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 0323fed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0323fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0323ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0323ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 0323ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 23
System Thread ID: 12b0
Kernel Time: 0:0:0.671
User Time: 0:0:8.781
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 032afdcc 7c822114 ntdll!KiFastSystemCallRet
01 032afdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 032afe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 032afed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 032afef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 032aff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 032affb8 77e66063 msvcrt!_endthreadex+0xa3
07 032affec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 24
System Thread ID: 17c4
Kernel Time: 0:0:0.31
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0375fd00 7c822124 ntdll!KiFastSystemCallRet
01 0375fd04 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0375fd74 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0375fd88 75bb22b9 kernel32!WaitForSingleObject+0x12
04 0375ffb8 77e66063 comsvcs!PingThread+0xf6
05 0375ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 25
System Thread ID: 1fe8
Kernel Time: 0:0:0.453
User Time: 0:0:2.937
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03b0fdcc 7c822114 ntdll!KiFastSystemCallRet
01 03b0fdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 03b0fe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 03b0fed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03b0fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03b0ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03b0ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 03b0ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 26
System Thread ID: 1a64
Kernel Time: 0:0:0.640
User Time: 0:0:3.390
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03defdcc 7c822114 ntdll!KiFastSystemCallRet
01 03defdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 03defe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 03defed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03defef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03deff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03deffb8 77e66063 msvcrt!_endthreadex+0xa3
07 03deffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 27
System Thread ID: 1cc0
Kernel Time: 0:0:1.578
User Time: 0:0:15.703
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03e6fdcc 7c822114 ntdll!KiFastSystemCallRet
01 03e6fdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 03e6fe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 03e6fed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03e6fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03e6ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03e6ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 03e6ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 28
System Thread ID: 1f38
Kernel Time: 0:0:0.765
User Time: 0:0:4.406
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03f2fdcc 7c822114 ntdll!KiFastSystemCallRet
01 03f2fdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 03f2fe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 03f2fed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03f2fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03f2ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03f2ffb8 77e66063 msvcrt!_endthreadex+0xa3
07 03f2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 29
System Thread ID: f28
Kernel Time: 0:0:0.125
User Time: 0:0:0.687
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 045ffdcc 7c822114 ntdll!KiFastSystemCallRet
01 045ffdd0 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 045ffe78 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 045ffed4 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 045ffef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 045fff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 045fffb8 77e66063 msvcrt!_endthreadex+0xa3
07 045fffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 30
System Thread ID: 15b8
Kernel Time: 0:0:0.62
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0487ff7c 7c821bf4 ntdll!KiFastSystemCallRet
01 0487ff80 71b23eb4 ntdll!NtRemoveIoCompletion+0xc
02 0487ffb8 77e66063 mswsock!SockAsyncThread+0x69
03 0487ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 31
System Thread ID: 1a34
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 03bcff70 7c821bf4 ntdll!KiFastSystemCallRet
01 03bcff74 7c83ad75 ntdll!NtRemoveIoCompletion+0xc
02 03bcffb8 77e66063 ntdll!RtlpWorkerThread+0x3d
03 03bcffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 32
System Thread ID: 1b90
Kernel Time: 0:0:1.765
User Time: 0:0:0.531
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 04bbfaa8 7c822124 ntdll!KiFastSystemCallRet
01 04bbfaac 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 04bbfb1c 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 04bbfb30 03a48e91 kernel32!WaitForSingleObject+0x12
04 04bbfe10 03a493ae etc_1_0_12_1!Etc10012::JTCCond::_wait+0x91
05 04bbfe24 03a4641a etc_1_0_12_1!Etc10012::JTCCond::wait+0x2e
06 04bbfe30 04967b4f etc_1_0_12_1!Etc10012::JTCMonitor::wait+0x1a
07 04bbfe8c 0496904a ebus_3_3_2_1!OBGIOPClientWorkerThreaded::remove+0x7f
08 04bbfed4 04969289 ebus_3_3_2_1!OBGIOPClientWorkerThreaded::senderRun+0x3a
09 04bbff14 03a43a4f
ebus_3_3_2_1!OBGIOPClientWorkerThreaded::SenderThread::run+0x29
0a 04bbff44 03a418cb
etc_1_0_12_1!Etc10012::JTCThread::_JTC_startThreadHook+0x8f
0b 04bbff84 77bcb530 etc_1_0_12_1!Etc10012::_JTC_threadAdapter+0x4b
0c 04bbffb8 77e66063 msvcrt!_endthreadex+0xa3
0d 04bbffec 00000000 kernel32!BaseThreadStart+0x34