The Java Link Checker spider is a simple spider that I wrote in Java to check for invalid links on a web site. The spider portion is well isolated and could easily be used in other Java projects where you need to spider through a web site. This progr
Spider Catching in ASP is an ASP article that deals with the spider caching of ASP pages. Here author provides some of the codes to generate content cloacking in their ASP pages. In this site author discusses about various method that are involved in
Torrents Spider and search engine is a perl based program. In this script the spider searches the torrent files using search engine and stores the torrent files in a database. This script checks only valid torrent files and stores in a database table
ASP Meta Tag Spider is an online application which helps in creating a search engine spider which extracts the metatag, delete HTML tag and shows the content of the webpage. This tool offers various features like detecting common meta tag, displaying
The Whois Domain Spider is a Perl script with which you will be able to find the details regarding a domain name availability and status of various domain names and their expiration date. All the details that are gathered such as expiring unix time,
Spider Trap is a set of perl program that provides functions to protect your webiste. In-built rewritten .htaccess module detects the errors with Apache server and inform them to site owners. All hyperlinks can be encoded to prevent abused accessings
A lightweight web spider and search engine written that is suitable for adding search functionality to small or medium sites (10k-20k pages). It can index both static and dynamic pages, supports NOT and phrase searches, and more.
Point this script at any page and it will build a list of all links and spider them.
SpiderView is a program which can spider a webpage, testing the links found on the page, evaluating your server and its performance.
ConnectFusion is a download manager that can accelerate your downloads by launching multiple threads to the remote server. It supports the resume feature and is capable of restarting a broken download due to lost connection. ConnectFusion includes an | 
