Search
Code Directory
 ASP
 ASP.NET
 C/C++
 CFML
 CGI/PERL
 Delphi
 Development
 Flash
 HTML
 Java
 JavaScript
 Pascal
 PHP
 Python
 SQL
 Tools
 Visual Basic & VB.NET
 XML
New Code
VB.Net PDF 4.4.7
SuiteCRM Survey Rocket Plugin 1.0
Airbnb Clone Script | Airbnb Clone 4.3.1
IP2Location Geolocation Database 2018
ODBC Driver for Salesforce 1.5
Rapid PHP 2018 15.0
Bytescout BarCode Generator SDK 4.70.0.981
Data Puppy Lite (32-bit) 1.0
ProZ clone script 1.0.3
VideoCap Live Streaming SDK ActiveX 8.5
Magento Web to Print 1.0
dbForge Data Compare for MySQL 5.4
dbForge Query Builder for MySQL 4.3
ODBC Driver for NetSuite 1.2
Rapid CSS 2018 15.0
Top Code
WebKit2.NET 0.10
Barcode ActiveX Control
ArtificialNeuronalNetwork 1.00
MLM Software ONE 1.5.46
blackjack.m 1.0
Jellybean Factory 1.0
Contrast Limited Adaptive Histogram Equalization (CLAHE) 1.0
College Management System Script 1.0.4
madExcept 3.0b
Infogate Courier Tracking 2.0
Fractional-order differential order equation solver 1.0
XMLFox Advance XML and XSD Editor 3.00
Sun Azimuth Data 1.0
CIAN Text Replacer 3.80
UseBB 6.0
Top Rated
Output Messenger 1.8.0
Aliexpress Clone- Ec21 Script 1
Indiegogo Clone 3.0
Online Food Ordeing System 1.0
PHP Image Resize Script 1.0
Best Spotify Clone 1.0
Get Random Record Based on Weight 1.0.0
Travel Portal Script 9.29
Magento Product Designer 1.0
OFOS - Just Eat Clone Script 1.0
PrestaShop Upload Images Module 1.2.1
Trading Software 1.2.4
Deals and Discounts Website Script 1.0.2
ADO.NET Provider for ExactTarget 1.0
Solid File System OS edition 5.1
Site Index for Scripts 1.0
File ID: 96559






Site Index for Scripts 1.0
Download Site Index for Scripts 1.0http://www.multipurposeweb.com/Report Error Link
License: Freeware
File Size: 10.0 KB
Downloads: 28
Submit Rating:
Site Index for Scripts 1.0 Description
Description: Site Index will spider website and extract all anchor links from all webpages. It can also extract titles and plain text.

URL Reduction

You might be astonished at how many ways there are to refer to the same location on the web. Here are just a few examples:
- http://www.domain.com/path/index.html
- http://www.domain.com/path/
- http://www.domain.com/path
- http://domain.com/path/index.html
The script will reduce such URLs to the same form so that only one link per webpage is indexed. It will optionally auto-append or strip www. prefix from domain name and auto-append or strip default filename index.* from url.

Query Strings

If you store session ids or some other random values in the query string the script will optionally remove them.

License: Freeware

Related: optionally, autoappend, strip, httpwwwdomaincompath, Script, Extract, Filename, Index, default, Domain, Website, Spider, prefix, urlquery, Store, Query, String, Remove, values, Random

O/S:Linux, Solaris, Mac OS X

File Size: 10.0 KB

Downloads: 28



More Similar Code

Chatologica Web-Site Accelerator for Apache helps in reducing of your outgoing traffic from a server and faster delivery of your static text web documents. It works only for web-sites hosted on Apache web server. The script modifies only the static web documents so that they could be transferred over network in a gzip compressed form, which is much faster and economic than a transfer in original plain form. When a browser like MS Internet...



TT Web Site Manager is a free general purpose database driven web application framework written in PHP, featuring support for multiple database servers.

It allows multiple web applications to be built and managed entirely on the fly...



Chipmunk Scripts is a site used for downloading PHP scripts and it has other categories like, Webmaster Directory which has entire scripts based in PHP, Perl, ASP, C & C++, Free Hosting, website promotion, dedicated hosting, javascript and...



This site has different scripts to download. It is a resource center for PHP based scripts. Available PHP resources are, honeymail, php mysqlgraph, site referrers, php alphawall etc., Programmers can post their codes into this site. Only members...



Meezerk.com is a site developed for users those who need programmes based on PHP. This site has three PHP scripts they are, cow time, cow counter and cow mail at present. Payment software is also available. Forum field is available from which you...



A site index script that lets users navigate through your site using a multi-level list, with categories and subcategories. It produces a list of links in a frame similar to the display of a file system in Windows Explorer. Users can expand and...



Features:

* Provides easy site navigation for your visitors.
* A variety of extra button sets are included.
* Simply copy, paste and upload...done!.
* Expandable - easily add or remove additional button links.
*...



The Taxonomy VTN module provides an index for vocabularies, terms and nodes just like those you find at the end of reference or technical books. It supports synonyms, terms, related terms, and parent/child relations. The root Taxonomy VTN path is...



BlogBlogs is the biggest brazilian index for blogs. This plugin is used to grab information about your site's visitors.

For every comment on your site the plugin checks if the user is registered at BlogBlogs and grabs all his/her info....



The book index generator generate the back-of-book index for Thai book automatically.

User Review for Site Index for Scripts
- required fields
     

Please enter text on the image