UrlCrawler is a Web spider which uses the result
to test other servers to figure out what files,
directories, or scripts are available. This can
then help to footprint Web servers.
Open source project that offer summary and download services on this page is a project that carry out their development work on other open source development sites. Their work is linked to this page via a feature called OFI, and their work is not carried out here on OSDN site.
