Search
Code Directory
 ASP
 ASP.NET
 C/C++
 CFML
 CGI/PERL
 Delphi
 Development
 Flash
 HTML
 Java
 JavaScript
 Pascal
 PHP
 Python
 SQL
 Tools
 Visual Basic & VB.NET
 XML
New Code
Magento Australia Post eParcel Extension 1.0
Airbnb Script - Airbnb Clone 1.0.3
Hotel Restaurant Reviews and Feedback Script 1.0.3
Documenter for MySQL 1.0
ODBC Driver for xBase 1.1
ODBC Driver for FreshBooks 2.0
AnyGantt JS Gantt Charts 8.4.2
The C# Barcode Library 4.0.2.2
ConyEdit for Windows 1.1.0
wolfSSL 3.15.5
Taxi Booking App Like Uber 1.0
IP2Location Geolocation Database 2018
Food Delivery Script 1.0.3
ODBC Driver for Magento 1.3
dbForge Studio for SQL Server 5.6
Top Code
Computational Statistics: Feature Selection, Regularization, and Shrinkage 1.0
Cuckoo Search (CS) Algorithm 1.0
Cuckoo Optimization Algorithm 1.0
AllWebMenus WordPress Menu Addin 1.0.8
Visual Basic game template 1.0
Open Source Visual Basic.Net Compiler 1.0
Basic 7 7
RAM Library b.2.7
DJ Java Decompiler 3.11.11.95
Guestbook-Comment Script 2.0
Top Rated
Deals and Discounts Website Script 1.0.2
ADO.NET Provider for ExactTarget 1.0
Solid File System OS edition 5.1
Classified Ad Lister 1.0
Aglowsoft SQL Query Tools 8.2
ICPennyBid Penny Auction Script 4.0
PHP Review Script 1.0
ATN Resume Finder 2.0
ATN Site Builder 3.0
Availability Booking Calendar PHP 1.0
PHP GZ Blog Script 1.1
ATN Jobs Software 4.0
ATN Mall 2.0
WeBuilder 2015 13.3
PHP Digital Download Script 1.0.4
Site Index for Scripts 1.0
File ID: 96559






Site Index for Scripts 1.0
Download Site Index for Scripts 1.0http://www.multipurposeweb.com/Report Error Link
License: Freeware
File Size: 10.0 KB
Downloads: 28
Submit Rating:
Site Index for Scripts 1.0 Description
Description: Site Index will spider website and extract all anchor links from all webpages. It can also extract titles and plain text.

URL Reduction

You might be astonished at how many ways there are to refer to the same location on the web. Here are just a few examples:
- http://www.domain.com/path/index.html
- http://www.domain.com/path/
- http://www.domain.com/path
- http://domain.com/path/index.html
The script will reduce such URLs to the same form so that only one link per webpage is indexed. It will optionally auto-append or strip www. prefix from domain name and auto-append or strip default filename index.* from url.

Query Strings

If you store session ids or some other random values in the query string the script will optionally remove them.

License: Freeware

Related: optionally, autoappend, strip, httpwwwdomaincompath, Script, Extract, Filename, Index, default, Domain, Website, Spider, prefix, urlquery, Store, Query, String, Remove, values, Random

O/S:Linux, Solaris, Mac OS X

File Size: 10.0 KB

Downloads: 28



More Similar Code

Chatologica Web-Site Accelerator for Apache helps in reducing of your outgoing traffic from a server and faster delivery of your static text web documents. It works only for web-sites hosted on Apache web server. The script modifies only the static web documents so that they could be transferred over network in a gzip compressed form, which is much faster and economic than a transfer in original plain form. When a browser like MS Internet...



TT Web Site Manager is a free general purpose database driven web application framework written in PHP, featuring support for multiple database servers.

It allows multiple web applications to be built and managed entirely on the fly...



Chipmunk Scripts is a site used for downloading PHP scripts and it has other categories like, Webmaster Directory which has entire scripts based in PHP, Perl, ASP, C & C++, Free Hosting, website promotion, dedicated hosting, javascript and...



This site has different scripts to download. It is a resource center for PHP based scripts. Available PHP resources are, honeymail, php mysqlgraph, site referrers, php alphawall etc., Programmers can post their codes into this site. Only members...



A site index script that lets users navigate through your site using a multi-level list, with categories and subcategories. It produces a list of links in a frame similar to the display of a file system in Windows Explorer. Users can expand and...



Features:

* Provides easy site navigation for your visitors.
* A variety of extra button sets are included.
* Simply copy, paste and upload...done!.
* Expandable - easily add or remove additional button links.
*...



The Taxonomy VTN module provides an index for vocabularies, terms and nodes just like those you find at the end of reference or technical books. It supports synonyms, terms, related terms, and parent/child relations. The root Taxonomy VTN path is...



BlogBlogs is the biggest brazilian index for blogs. This plugin is used to grab information about your site's visitors.

For every comment on your site the plugin checks if the user is registered at BlogBlogs and grabs all his/her info....



The book index generator generate the back-of-book index for Thai book automatically.



Bug/Feature tracking software for scripts. Currently includes Feature Suggestions, Popularity, Comments, Bug Tracking, Developers, Feature Information, News & Updates System, Member System and heaps more.

User Review for Site Index for Scripts
- required fields
     

Please enter text on the image