Hello all

I have a problem with two of my webservers periodically generating a very
large ASP queue. This continues while IIS tries to recover and restart
services but will continue to largely impact server performance until I
restart IIS 6.0 I am reasonably confident that this is an issue with a site
on our web server (we do large scale hosting) but have been unable to
pinpoint the site causing the problem.

Reading over troubleshooting guidelines on Microsoft's web site I have taken
an IISState logfile and would appreciate if any of the more knowledgeable
admins here can take a look at it.

Here is the log file taken during the large queue. Thanks in advance to
anyone who can help with this.

Opened log file 'C:\Program Files\IISState\output\IISState-5196.log'

***********************
Starting new log output
IISState version 3.3.1

Sat May 07 23:56:43 2005

OS = Windows 2003 Server
Executable: inetinfo.exe
PID = 5196

Note: Thread times are formatted as HH:MM:SS.ms

***********************




Thread ID: 0
System Thread ID: 8c0
Kernel Time: 0:0:0.31
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0006f9a8 77f4303b SharedUserData!SystemCallStub+0x4
01 0006f9ac 77e4905d ntdll!NtReadFile+0xc
02 0006fa14 77db51f1 kernel32!ReadFile+0x16c
03 0006fa40 77db5297 ADVAPI32!ScGetPipeInput+0x28
04 0006fab0 77dfa7f1 ADVAPI32!ScDispatcherLoop+0x4c
05 0006fcec 01002655 ADVAPI32!StartServiceCtrlDispatcherA+0x91
06 0006fe1c 010027ea inetinfo!StartDispatchTable+0x214
07 0006ff44 01003160 inetinfo!main+0x104
08 0006ffc0 77e4f38c inetinfo!mainCRTStartup+0x12f
09 0006fff0 00000000 kernel32!BaseProcessStart+0x23




Thread ID: 1
System Thread ID: 214
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 0083fe18 77f43741 SharedUserData!SystemCallStub+0x4
01 0083fe1c 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 0083fe8c 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 0083fe9c 01002cf9 kernel32!WaitForSingleObject+0xf
04 0083ffb8 77e4a990 inetinfo!W3SVCThreadEntry+0x3b
05 0083ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 2
System Thread ID: f98
Kernel Time: 0:0:0.375
User Time: 0:0:2.15
Thread Type: Other
# ChildEBP RetAddr
00 0087fcc4 77f43741 SharedUserData!SystemCallStub+0x4
01 0087fcc8 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 0087fd38 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 0087fd48 649f24ac kernel32!WaitForSingleObject+0xf
04 0087fd70 010023b6 iisadmin!ServiceEntry+0x214
05 0087ffa8 77db571b inetinfo!InetinfoStartService+0x2a6
06 0087ffb8 77e4a990 ADVAPI32!ScSvcctrlThreadA+0xe
07 0087ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 3
System Thread ID: 11e8
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00a7ff9c 77f4262b SharedUserData!SystemCallStub+0x4
01 00a7ffa0 77f6b5b2 ntdll!NtDelayExecution+0xc
02 00a7ffb8 77e4a990 ntdll!RtlpTimerThread+0x45
03 00a7ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 4
System Thread ID: 4ec
Kernel Time: 0:0:0.343
User Time: 0:0:1.453
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00b8feb0 77f4372d SharedUserData!SystemCallStub+0x4
01 00b8feb4 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 00b8ff5c 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 00b8ff74 6e0b377a kernel32!WaitForMultipleObjects+0x17
04 00b8ffa0 6e0b6012 COADMIN!NOTIFY_CONTEXT::GetNextContext+0x68
05 00b8ffb8 77e4a990 COADMIN!NOTIFY_CONTEXT::NotifyThreadProc+0x62
06 00b8ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 5
System Thread ID: e9c
Kernel Time: 0:0:0.203
User Time: 0:0:0.125
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0189feac 77f4372d SharedUserData!SystemCallStub+0x4
01 0189feb0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0189ff58 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 0189ff70 620b401a kernel32!WaitForMultipleObjects+0x17
04 0189ffb0 620b4390 metadata!CListenerController::Listen+0x27
05 0189ffb8 77e4a990 metadata!StartListenerThread+0x16
06 0189ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 6
System Thread ID: fa4
Kernel Time: 0:0:0.250
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0195feac 77f4372d SharedUserData!SystemCallStub+0x4
01 0195feb0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0195ff58 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 0195ff70 648c95a4 kernel32!WaitForMultipleObjects+0x17
04 0195ffac 648c983d IISCFG!CListener::Listen+0x21
05 0195ffb8 77e4a990 IISCFG!CListener::ListenerThreadStart+0x35
06 0195ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 7
System Thread ID: 1648
Kernel Time: 0:0:0.375
User Time: 0:0:2.343
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 0199fbc0 77f4372d SharedUserData!SystemCallStub+0x4
01 0199fbc4 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0199fc6c 77d076f5 kernel32!WaitForMultipleObjectsEx+0x11a
03 0199fcc8 77d077f5 USER32!RealMsgWaitForMultipleObjectsEx+0x13f
04 0199fce4 643f5723 USER32!MsgWaitForMultipleObjects+0x1d
05 0199fd30 6b772f7d INFOCOMM!IIS_SERVICE::StartServiceOperation+0x22f
06 0199fd70 010023b6 SMTPSVC!ServiceEntry+0x129
07 0199ffa8 77db571b inetinfo!InetinfoStartService+0x2a6
08 0199ffb8 77e4a990 ADVAPI32!ScSvcctrlThreadA+0xe
09 0199ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 8
System Thread ID: 13a4
Kernel Time: 0:0:1.468
User Time: 0:0:0.437
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 019dfbc0 77f4372d SharedUserData!SystemCallStub+0x4
01 019dfbc4 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 019dfc6c 77d076f5 kernel32!WaitForMultipleObjectsEx+0x11a
03 019dfcc8 77d077f5 USER32!RealMsgWaitForMultipleObjectsEx+0x13f
04 019dfce4 643f5723 USER32!MsgWaitForMultipleObjects+0x1d
05 019dfd30 6930d973 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x22f
06 019dfd70 010023b6 ftpsvc2!ServiceEntry+0xac
07 019dffa8 77db571b inetinfo!InetinfoStartService+0x2a6
08 019dffb8 77e4a990 ADVAPI32!ScSvcctrlThreadA+0xe
09 019dffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 9
System Thread ID: 158c
Kernel Time: 0:0:0.171
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01cefcec 77f4372d SharedUserData!SystemCallStub+0x4
01 01cefcf0 77f75297 ntdll!NtWaitForMultipleObjects+0xc
02 01ceffb8 77e4a990 ntdll!RtlpWaitThread+0x158
03 01ceffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 10
System Thread ID: 1670
Kernel Time: 0:0:31.875
User Time: 0:0:5.859
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 01d6ff50 77f430c7 SharedUserData!SystemCallStub+0x4
01 01d6ff54 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 01d6ff80 63ec7235 kernel32!GetQueuedCompletionStatus+0x27
03 01d6ffb8 77e4a990 ISATQ!AtqPoolThread+0x40
04 01d6ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 11
System Thread ID: 908
Kernel Time: 0:0:24.234
User Time: 0:0:4.62
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 01daf504 77f426cb SharedUserData!SystemCallStub+0x4
01 01daf508 71b216a6 ntdll!NtDeviceIoControlFile+0xc
02 01daf594 71c0141c mswsock!WSPSend+0x16b
03 01daf5dc 6930e133 WS2_32!send+0x80
04 01daf60c 6930e3a3 ftpsvc2!SockSend+0x68
05 01dafa30 6930e3f5 ftpsvc2!vSockReply+0xe2
06 01dafa50 6931103c ftpsvc2!ReplyToUser+0x2d
07 01dafa78 69311c9f ftpsvc2!USER_DATA::StartupSession+0x6a
08 01dafaa0 69309568 ftpsvc2!USER_DATA::ProcessAsyncIoCompletion+0x2f0
09 01dafefc 6930994c ftpsvc2!ProcessNewClient+0x182
0a 01daff4c 63ec675a ftpsvc2!FtpdNewConnectionEx+0x17b
0b 01daff60 63ec71ae ISATQ!ATQ_CONTEXT::ConnectionCompletion+0x15
0c 01daff84 63ec73c6 ISATQ!AtqpProcessContext+0x1b6
0d 01daffb8 77e4a990 ISATQ!AtqPoolThread+0x1d1
0e 01daffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 12
System Thread ID: c0c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 024efe20 77f4313f SharedUserData!SystemCallStub+0x4
01 024efe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 024eff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 024eff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 024effb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 024effb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 024effec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 13
System Thread ID: 1094
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 0252feb4 77f430c7 SharedUserData!SystemCallStub+0x4
01 0252feb8 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 0252fee4 77c80bd1 kernel32!GetQueuedCompletionStatus+0x27
03 0252ff20 77c80a78 RPCRT4!COMMON_ProcessCalls+0x9f
04 0252ff8c 77c58159 RPCRT4!LOADABLE_TRANSPORT::ProcessIOEvents+0x115
05 0252ff90 77c60771 RPCRT4!ProcessIOEventsWrapper+0x9
06 0252ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
07 0252ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
08 0252ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 14
System Thread ID: 1114
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0256fecc 77f4372d SharedUserData!SystemCallStub+0x4
01 0256fed0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0256ff78 6930882e kernel32!WaitForMultipleObjectsEx+0x11a
03 0256ffb8 77e4a990 ftpsvc2!PASV_ACCEPT_CONTEXT::AcceptThreadFunc+0x32
04 0256ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 15
System Thread ID: 12c0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 025efec8 77f4372d SharedUserData!SystemCallStub+0x4
01 025efecc 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 025eff74 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 025eff8c 69532430 kernel32!WaitForMultipleObjects+0x17
04 025effb8 77e4a990 exstrace!RegNotifyThread+0x68
05 025effec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 16
System Thread ID: 134c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0262fecc 77f4372d SharedUserData!SystemCallStub+0x4
01 0262fed0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0262ff78 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 0262ff90 695319c0 kernel32!WaitForMultipleObjects+0x17
04 0262ffb8 77e4a990 exstrace!WriteTraceThread+0x2f
05 0262ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 17
System Thread ID: 234
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 029cff18 77f43741 SharedUserData!SystemCallStub+0x4
01 029cff1c 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 029cff8c 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 029cff9c 019e8673 kernel32!WaitForSingleObject+0xf
04 029cffb8 77e4a990 FCACHDLL!CScheduleThread::ScheduleThread+0x60
05 029cffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 18
System Thread ID: c34
Kernel Time: 0:0:0.31
User Time: 0:0:0.62
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 02b0fec0 77f4372d SharedUserData!SystemCallStub+0x4
01 02b0fec4 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 02b0ff6c 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 02b0ff84 6b78b1f6 kernel32!WaitForMultipleObjects+0x17
04 02b0ffb8 77e4a990 SMTPSVC!TcpRegNotifyThread+0xdc
05 02b0ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 19
System Thread ID: 1474
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 02b4ff20 77f43741 SharedUserData!SystemCallStub+0x4
01 02b4ff24 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 02b4ff94 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 02b4ffa4 6b78b09a kernel32!WaitForSingleObject+0xf
04 02b4ffb8 77e4a990 SMTPSVC!FreeLibThread+0x2c
05 02b4ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 20
System Thread ID: 1120
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 027afe38 77f43741 SharedUserData!SystemCallStub+0x4
01 027afe3c 71b23ac3 ntdll!ZwWaitForSingleObject+0xc
02 027afe78 71b239d1 mswsock!SockWaitForSingleObject+0x19b
03 027aff3c 71c016c9 mswsock!WSPSelect+0x229
04 027aff8c 63ec4696 WS2_32!select+0xb9
05 027affb4 63ec4700 ISATQ!ATQ_BMON_SET::BmonThreadFunc+0x22
06 027affb8 77e4a990 ISATQ!BmonThreadFunc+0x9
07 027affc4 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 21
System Thread ID: 17ac
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 027efecc 77f4372d SharedUserData!SystemCallStub+0x4
01 027efed0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 027eff78 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 027eff90 693079de kernel32!WaitForMultipleObjects+0x17
04 027effb8 77e4a990 ftpsvc2!ADIO_ASYNC::WorkerThread+0x5c
05 027effec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 22
System Thread ID: e1c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0282fecc 77f4372d SharedUserData!SystemCallStub+0x4
01 0282fed0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0282ff78 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 0282ff90 693079de kernel32!WaitForMultipleObjects+0x17
04 0282ffb8 77e4a990 ftpsvc2!ADIO_ASYNC::WorkerThread+0x5c
05 0282ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 23
System Thread ID: 6f8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 0318fe20 77f4313f SharedUserData!SystemCallStub+0x4
01 0318fe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 0318ff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 0318ff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 0318ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 0318ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 0318ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 24
System Thread ID: cd8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 031dfe20 77f4313f SharedUserData!SystemCallStub+0x4
01 031dfe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 031dff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 031dff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 031dffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 031dffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 031dffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 25
System Thread ID: 1118
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0321ff10 77f43741 SharedUserData!SystemCallStub+0x4
01 0321ff14 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 0321ff84 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 0321ff94 0310d064 kernel32!WaitForSingleObject+0xf
04 0321ffb8 77e4a990 aqueue!CSMTP_RETRY_HANDLER::RetryThreadRoutine+0xc1
05 0321ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 26
System Thread ID: 1230
Kernel Time: 0:0:0.62
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 0329fe84 77f4372d SharedUserData!SystemCallStub+0x4
01 0329fe88 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0329ff30 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 0329ff48 030ec648 kernel32!WaitForMultipleObjects+0x17
04 0329ffa4 6b77e7ce aqueue!CConnMgr::GetNextConnection+0x1e1
05 0329ffb8 77e4a990 SMTPSVC!PERSIST_QUEUE::QueueThreadRoutine+0x21
06 0329ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 27
System Thread ID: 1ac
Kernel Time: 0:0:21.31
User Time: 0:0:4.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0118ff50 77f430c7 SharedUserData!SystemCallStub+0x4
01 0118ff54 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 0118ff80 63ec7235 kernel32!GetQueuedCompletionStatus+0x27
03 0118ffb8 77e4a990 ISATQ!AtqPoolThread+0x40
04 0118ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 28
System Thread ID: 9cc
Kernel Time: 0:0:2.437
User Time: 0:0:0.546
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00e6ff50 77f430c7 SharedUserData!SystemCallStub+0x4
01 00e6ff54 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 00e6ff80 63ec7235 kernel32!GetQueuedCompletionStatus+0x27
03 00e6ffb8 77e4a990 ISATQ!AtqPoolThread+0x40
04 00e6ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 29
System Thread ID: 1030
Kernel Time: 0:0:4.218
User Time: 0:0:10.171
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 00d2fe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00d2fe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00d2ff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00d2ff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00d2ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00d2ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00d2ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 30
System Thread ID: 700
Kernel Time: 0:0:3.859
User Time: 0:0:10.296
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 00f1fe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00f1fe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00f1ff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00f1ff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00f1ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00f1ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00f1ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 31
System Thread ID: 868
Kernel Time: 0:0:3.468
User Time: 0:0:7.31
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 00cefe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00cefe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00ceff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00ceff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00ceffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00ceffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00ceffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 32
System Thread ID: 12a0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00deff70 77f430c7 SharedUserData!SystemCallStub+0x4
01 00deff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
02 00deffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
03 00deffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 33
System Thread ID: ea4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 00e2fe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00e2fe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00e2ff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00e2ff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00e2ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00e2ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00e2ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 34
System Thread ID: 1520
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 00edfe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00edfe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00edff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00edff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00edffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00edffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00edffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 35
System Thread ID: d44
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00f7ff70 77f430c7 SharedUserData!SystemCallStub+0x4
01 00f7ff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
02 00f7ffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
03 00f7ffec 00000000 kernel32!BaseThreadStart+0x34

*****

Dump name is formatted as: PID-Timestamp.dmp

Creating C:\Program Files\IISState\output\5196-1115481528.dmp - mini user
dump

*****

Closing open log file C:\Program Files\IISState\output\IISState-5196.log

Re: IIS 6.0 and perodical ASP queue issue. IISState log attached. by Ken

Ken
Sun May 08 21:28:27 CDT 2005

Hi,

I'm not sure there is any issue with InetInfo.exe (just looking at the log
below). If this is IIS6, and you are running in Worker Process Isolation
Mode, you may need to dump the relevant w3wp.exe process rather than
InetInfo.exe

Cheers
Ken

--
Blog: www.adopenstatic.com/cs/blogs/ken/
Web: www.adopenstatic.com


"David Olive" <djolive@westnet.com.au> wrote in message
news:OIwP9c7UFHA.548@tk2msftngp13.phx.gbl...
: Hello all
:
: I have a problem with two of my webservers periodically generating a very
: large ASP queue. This continues while IIS tries to recover and restart
: services but will continue to largely impact server performance until I
: restart IIS 6.0 I am reasonably confident that this is an issue with a
site
: on our web server (we do large scale hosting) but have been unable to
: pinpoint the site causing the problem.
:
: Reading over troubleshooting guidelines on Microsoft's web site I have
taken
: an IISState logfile and would appreciate if any of the more knowledgeable
: admins here can take a look at it.
:
: Here is the log file taken during the large queue. Thanks in advance to
: anyone who can help with this.
:
: Opened log file 'C:\Program Files\IISState\output\IISState-5196.log'
:
: ***********************
: Starting new log output
: IISState version 3.3.1
:
: Sat May 07 23:56:43 2005
:
: OS = Windows 2003 Server
: Executable: inetinfo.exe
: PID = 5196
:
: Note: Thread times are formatted as HH:MM:SS.ms
:
: ***********************
:
:
:
:
: Thread ID: 0
: System Thread ID: 8c0
: Kernel Time: 0:0:0.31
: User Time: 0:0:0.0
: Thread Type: Other
: # ChildEBP RetAddr
: 00 0006f9a8 77f4303b SharedUserData!SystemCallStub+0x4
: 01 0006f9ac 77e4905d ntdll!NtReadFile+0xc
: 02 0006fa14 77db51f1 kernel32!ReadFile+0x16c
: 03 0006fa40 77db5297 ADVAPI32!ScGetPipeInput+0x28
: 04 0006fab0 77dfa7f1 ADVAPI32!ScDispatcherLoop+0x4c
: 05 0006fcec 01002655 ADVAPI32!StartServiceCtrlDispatcherA+0x91
: 06 0006fe1c 010027ea inetinfo!StartDispatchTable+0x214
: 07 0006ff44 01003160 inetinfo!main+0x104
: 08 0006ffc0 77e4f38c inetinfo!mainCRTStartup+0x12f
: 09 0006fff0 00000000 kernel32!BaseProcessStart+0x23
:
:
:
:
: Thread ID: 1
: System Thread ID: 214
: Kernel Time: 0:0:0.0
: User Time: 0:0:0.15
: Thread Type: Other
: # ChildEBP RetAddr
: 00 0083fe18 77f43741 SharedUserData!SystemCallStub+0x4
: 01 0083fe1c 77e41817 ntdll!ZwWaitForSingleObject+0xc
: 02 0083fe8c 77e4168f kernel32!WaitForSingleObjectEx+0xac
: 03 0083fe9c 01002cf9 kernel32!WaitForSingleObject+0xf
: 04 0083ffb8 77e4a990 inetinfo!W3SVCThreadEntry+0x3b
: 05 0083ffec 00000000 kernel32!BaseThreadStart+0x34
:
:
:
:
: Thread ID: 2
: System Thread ID: f98
: Kernel Time: 0:0:0.375
: User Time: 0:0:2.15
: Thread Type: Other
: # ChildEBP RetAddr
: 00 0087fcc4 77f43741 SharedUserData!SystemCallStub+0x4
: 01 0087fcc8 77e41817 ntdll!ZwWaitForSingleObject+0xc
: 02 0087fd38 77e4168f kernel32!WaitForSingleObjectEx+0xac
: 03 0087fd48 649f24ac kernel32!WaitForSingleObject+0xf
: 04 0087fd70 010023b6 iisadmin!ServiceEntry+0x214
: 05 0087ffa8 77db571b inetinfo!InetinfoStartService+0x2a6
: 06 0087ffb8 77e4a990 ADVAPI32!ScSvcctrlThreadA+0xe
: 07 0087ffec 00000000 kernel32!BaseThreadStart+0x34
:
:
:
:
: Thread ID: 3
: System Thread ID: 11e8
: Kernel Time: 0:0:0.15
: User Time: 0:0:0.0
: Thread Type: Other
: # ChildEBP RetAddr
: 00 00a7ff9c 77f4262b SharedUserData!SystemCallStub+0x4
: 01 00a7ffa0 77f6b5b2 ntdll!NtDelayExecution+0xc
: 02 00a7ffb8 77e4a990 ntdll!RtlpTimerThread+0x45
: 03 00a7ffec 00000000 kernel32!BaseThreadStart+0x34
:
:
:
:
: Thread ID: 4
: System Thread ID: 4ec
: Kernel Time: 0:0:0.343
: User Time: 0:0:1.453
: Thread Status: Thread is in a WAIT state.
: Thread Type: Other
: # ChildEBP RetAddr
: 00 00b8feb0 77f4372d SharedUserData!SystemCallStub+0x4
: 01 00b8feb4 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
: 02 00b8ff5c 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
: 03 00b8ff74 6e0b377a kernel32!WaitForMultipleObjects+0x17
: 04 00b8ffa0 6e0b6012 COADMIN!NOTIFY_CONTEXT::GetNextContext+0x68
: 05 00b8ffb8 77e4a990 COADMIN!NOTIFY_CONTEXT::NotifyThreadProc+0x62
: 06 00b8ffec 00000000 kernel32!BaseThreadStart+0x34
:
:
:
:
: Thread ID: 5
: System Thread ID: e9c
: Kernel Time: 0:0:0.203
: User Time: 0:0:0.125
: Thread Status: Thread is in a WAIT state.
: Thread Type: Other
: # ChildEBP RetAddr
: 00 0189feac 77f4372d SharedUserData!SystemCallStub+0x4
: 01 0189feb0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
: 02 0189ff58 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
: 03 0189ff70 620b401a kernel32!WaitForMultipleObjects+0x17
: 04 0189ffb0 620b4390 metadata!CListenerController::Listen+0x27
: 05 0189ffb8 77e4a990 metadata!StartListenerThread+0x16
: 06 0189ffec 00000000 kernel32!BaseThreadStart+0x34
:
:
:
:
: Thread ID: 6
: System Thread ID: fa4
: Kernel Time: 0:0:0.250
: User Time: 0:0:0.31
: Thread Status: Thread is in a WAIT state.
: Thread Type: Other
: # ChildEBP RetAddr
: 00 0195feac 77f4372d SharedUserData!SystemCallStub+0x4
: 01 0195feb0 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
: 02 0195ff58 77e4b0e4 kernel32