Source Code Online Home Categories Top Code New Code Submit Code
Search
New Code
Larbin 1.1.2002
harvest 1.7.2028
Top Code
Larbin 1.1.2002
harvest 1.7.2028
C/C++ > Searching > Web Indexing
Source List

Code 1-2 of 2   


Larbin is a web crawler (also called (web) robot, spider, scooter, etc). It is intended to fetch a large number of web pages to fill the database of a search engine. With a network fast enough, Larbin should be able to fetch more than 100 millions...





Harvest is a system to collect information and make them searchable using a web interface. Harvest can collect information on inter- and intranet using http, ftp, nntp as well as local files like data on harddisk, CDROM and files on file servers....