Everything runs smoothly for a while (weeks, sometimes only days), and then
IIS stops processing requests for ASP pages. I don't see any error messages
in either the Event Log or the W3SVC log. The W3SVC log doesn't even show
attempts to load (GET) the ASP files, although it does show HTML files
loading just fine.
I'm running Windows 2000 SP4 and IIS 5.0. I'm up to date with Microsoft
Updates.
There are several Virtual Directories, most of which include lots of ASP
pages. Some of those ASP pages use COM DLLs written in Visual Basic.
CPU and memory look fine.
The first time this happened, I tried to start the IIS Console so I could
cycle IIS, but the IIS Console wouldn't start--I had to reboot to make
everything right again.
The second time this happened, the IIS Console started, but after it had
been running for 10 minutes or so, when I tried to display the Default Web
Site Properties, it hung. I had to reboot.
Once the IIS Console is hung, I can't stop the WWW Publishing Service,
probably because it wants to stop the IIS Admin Service, which is hung with
the IIS Console.
I can reproduce this on my test server using the Web Application Stress
Tool, although it sometimes takes several runs to make it happen. I've seen
it happen on my production server when the system has been pretty idle,
though, so I'm not sure it's related to stressing the server.
I originally posted this problem report at WindowsITPro, and Tom Kaminski
suggested I install and run IISstate and post the dump here. I'm not sure how
to post the dump file (I don't see a way to upload or attach a file), but the
IISstate log file is below.
I'd appreciate any help you could give me! Thanks-
MJ.
The IISstate log file:
Opened log file 'C:\Program Files\IISstate\output\IISState-1876.log'
***********************
Starting new log output
IISState version 3.3.1
Wed Mar 30 12:31:02 2005
OS = Windows 2000
Executable: inetinfo.exe
PID = 1876
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: 75c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0006f89c 7c5862e9 ntdll!ZwReadFile+0xb
01 0006f910 7c2e4cd9 KERNEL32!ReadFile+0x181
02 0006f93c 7c2e4b5f ADVAPI32!ScGetPipeInput+0x28
03 0006f9b8 7c2e6632 ADVAPI32!ScDispatcherLoop+0x4a
04 0006fbf4 01002884 ADVAPI32!StartServiceCtrlDispatcherA+0x7d
05 0006fd30 01001e94 inetinfo!StartDispatchTable+0x2f1
06 0006ff70 01002fbf inetinfo!main+0x654
07 0006ffc0 7c59893d inetinfo!mainCRTStartup+0xff
08 0006fff0 00000000 KERNEL32!BaseProcessStart+0x3d
Thread ID: 1
System Thread ID: 2c4
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Type: Other
# ChildEBP RetAddr
00 005dfd1c 7c599fe4 ntdll!ZwWaitForSingleObject+0xb
01 005dfd44 7c57b3db KERNEL32!WaitForSingleObjectEx+0x71
02 005dfd54 6e6f1685 KERNEL32!WaitForSingleObject+0xf
03 005dfd70 01002440 iisadmin!ServiceEntry+0x156
04 005dffa4 7c2e4e9b inetinfo!InetinfoStartService+0x2bd
05 005dffb4 7c57b388 ADVAPI32!ScSvcctrlThreadW+0xe
06 005dffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 2
System Thread ID: 6e0
Kernel Time: 0:0:0.484
User Time: 0:0:0.218
Thread Type: Other
# ChildEBP RetAddr
00 0071fe5c 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0071feac 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0071ff08 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0071ff24 6e5a5a7c USER32!MsgWaitForMultipleObjects+0x1d
04 0071ff7c 780085bc IisRTL!SchedulerWorkerThread+0xa7
05 0071ffb4 7c57b388 MSVCRT!_endthreadex+0xc1
06 0071ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 3
System Thread ID: 680
Kernel Time: 0:0:0.609
User Time: 0:0:0.156
Thread Type: Other
# ChildEBP RetAddr
00 0075fe5c 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0075feac 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0075ff08 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0075ff24 6e5a5a7c USER32!MsgWaitForMultipleObjects+0x1d
04 0075ff7c 780085bc IisRTL!SchedulerWorkerThread+0xa7
05 0075ffb4 7c57b388 MSVCRT!_endthreadex+0xc1
06 0075ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 4
System Thread ID: bbc
Kernel Time: 0:0:0.328
User Time: 0:0:0.187
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 00bcfe24 77d37ba7 ntdll!ZwReplyWaitReceivePortEx+0xb
01 00bcff74 77d37b4c RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x74
02 00bcff78 77d35924 RPCRT4!RecvLotsaCallsWrapper+0x9
03 00bcffa8 77d358d6 RPCRT4!BaseCachedThreadRoutine+0x4f
04 00bcffb4 7c57b388 RPCRT4!ThreadStartRoutine+0x18
05 00bcffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 5
System Thread ID: 1c4
Kernel Time: 0:0:0.78
User Time: 0:0:0.31
Thread Type: Other
# ChildEBP RetAddr
00 00e5fc1c 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 00e5fc6c 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 00e5fcc8 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 00e5fce4 769c71e0 USER32!MsgWaitForMultipleObjects+0x1d
04 00e5fd30 65f0cfd8 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x209
05 00e5fd70 01002440 w3svc!ServiceEntry+0x1b5
06 00e5ffa4 7c2e4e9b inetinfo!InetinfoStartService+0x2bd
07 00e5ffb4 7c57b388 ADVAPI32!ScSvcctrlThreadW+0xe
08 00e5ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 6
System Thread ID: 73c
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00e9fc1c 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 00e9fc6c 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 00e9fcc8 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 00e9fce4 769c71e0 USER32!MsgWaitForMultipleObjects+0x1d
04 00e9fd30 6fc6b2f0 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x209
05 00e9fd70 01002440 ftpsvc2!ServiceEntry+0xc7
06 00e9ffa4 7c2e4e9b inetinfo!InetinfoStartService+0x2bd
07 00e9ffb4 7c57b388 ADVAPI32!ScSvcctrlThreadW+0xe
08 00e9ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 7
System Thread ID: 850
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00fdff5c 7c5853d7 ntdll!ZwRemoveIoCompletion+0xb
01 00fdff88 6d7029ef KERNEL32!GetQueuedCompletionStatus+0x27
02 00fdffb4 7c57b388 ISATQ!I_AtqOplockThreadFunc+0x32
03 00fdffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 8
System Thread ID: 998
Kernel Time: 0:0:0.109
User Time: 0:0:0.406
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0104ff50 7c5853d7 ntdll!ZwRemoveIoCompletion+0xb
01 0104ff7c 6d702957 KERNEL32!GetQueuedCompletionStatus+0x27
02 0104ffb4 7c57b388 ISATQ!AtqPoolThread+0x40
03 0104ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 9
System Thread ID: 738
Kernel Time: 0:0:0.93
User Time: 0:0:0.453
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0108ff50 7c5853d7 ntdll!ZwRemoveIoCompletion+0xb
01 0108ff7c 6d702957 KERNEL32!GetQueuedCompletionStatus+0x27
02 0108ffb4 7c57b388 ISATQ!AtqPoolThread+0x40
03 0108ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 10
System Thread ID: bb8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 0120feb8 7c5853d7 ntdll!ZwRemoveIoCompletion+0xb
01 0120fee4 77d31394 KERNEL32!GetQueuedCompletionStatus+0x27
02 0120ff20 77d3e93f RPCRT4!COMMON_ProcessCalls+0x9e
03 0120ff74 77d3e8c2 RPCRT4!LOADABLE_TRANSPORT::ProcessIOEvents+0x99
04 0120ff78 77d35924 RPCRT4!ProcessIOEventsWrapper+0x9
05 0120ffa8 77d358d6 RPCRT4!BaseCachedThreadRoutine+0x4f
06 0120ffb4 7c57b388 RPCRT4!ThreadStartRoutine+0x18
07 0120ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 11
System Thread ID: bc0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0144fd20 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0144fd70 7c59a0c2 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0144fd88 778322b2 KERNEL32!WaitForMultipleObjects+0x17
03 0144ffb4 7c57b388 RTUTILS!TraceServerThread+0xde
04 0144ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 12
System Thread ID: 780
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 0149ff00 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0149ff50 75037871 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0149ff6c 6fc66e80 WS2_32!WSAWaitForMultipleEvents+0x18
03 0149ffb4 7c57b388 ftpsvc2!PASV_ACCEPT_CONTEXT::AcceptThreadFunc+0x39
04 0149ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 13
System Thread ID: 7d4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 014eff5c 7c599fe4 ntdll!ZwWaitForSingleObject+0xb
01 014eff84 7c57b3db KERNEL32!WaitForSingleObjectEx+0x71
02 014eff94 732c3366 KERNEL32!WaitForSingleObject+0xf
03 014effb4 7c57b388 compfilt!CompressionThread+0x29
04 014effc0 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 14
System Thread ID: e60
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0161fdfc 74fd1394 ntdll!ZwWaitForSingleObject+0xb
01 0161fe38 74fd3c59 msafd!SockWaitForSingleObject+0x1a8
02 0161ff24 750312f5 msafd!WSPSelect+0x24e
03 0161ff88 6d7075bd WS2_32!select+0xe7
04 0161ffb0 6d70791b ISATQ!ATQ_BMON_SET::BmonThreadFunc+0x22
05 0161ffb4 7c57b388 ISATQ!BmonThreadFunc+0x9
06 0161ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 15
System Thread ID: a74
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 0165fe70 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0165fec0 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0165ff1c 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0165ff38 65f09ccb USER32!MsgWaitForMultipleObjects+0x1d
04 0165ff7c 78008454 w3svc!CMTACallbackThread::Thread+0x42
05 0165ffb4 7c57b388 MSVCRT!_endthread+0xc6
06 0165ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 16
System Thread ID: e64
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0169fea8 7c59a1af ntdll!ZwWaitForMultipleObjects+0xb
01 0169fef8 77e1e9a5 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0169ff54 77e1e9f2 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0169ff70 65f09d47 USER32!MsgWaitForMultipleObjects+0x1d
04 0169ffb4 7c57b388 w3svc!OleHackThread+0x88
05 0169ffec 00000000 KERNEL32!BaseThreadStart+0x52
Thread ID: 17
System Thread ID: 6c4
Kernel Time: 0:0:0.0
User Time: