Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?

Re: Crawl a site by Eric

Eric
Sun Jun 27 15:29:52 CDT 2004

Dave wrote:
> Is it possible to crawl a site using ASP & XML HTTP?
>
> I know you can hit one link, but how can you go through each link in a
> page and validate that it returns 200?

Using PerlScript and the Robot module.

http://search.cpan.org/~awrigley/WWW-Robot-0.023/lib/WWW/Robot.pm

Eric