Search
Code Directory
 ASP
 ASP.NET
 C/C++
 CFML
 CGI/PERL
 Delphi
 Development
 Flash
 HTML
 Java
 JavaScript
 Pascal
 PHP
 Python
 SQL
 Tools
 Visual Basic & VB.NET
 XML
New Code
Paste phpSoftPro 1.4.1
Bytescout PDF SDK 1.8.1.243
Odoo Crafito Theme 1.0
Uber Clone- Taxi Booking App 4.1
Excel Add-in for BigCommerce 1.7
Online Food Delivery Script php 1.0.3
Break Script | Youtube Clone Script 1.0.3
Advanced Content Manager Magento 2 extension 2.2.x
dbForge Studio for PostgreSQL 1.0
ODBC Driver for Salesforce MC 1.3
Social Media Script 1.0
ByteScout PDF Renderer SDK 9.0.0.3079
Magento Mobile App Builder 2.0.0
Binary MLM Plan 1.0.2
Review Assistant 4.0
Top Code
VISCOM Video Editing SDK ActiveX 8.53
Free Pageant Contest Source Code 1.0
wc_remote 1.0
VISCOM Audio Sound Record Pro ActiveX SDK 1.4
LMD ElPack SE 4.05
DS SQL Tools 1.1
Top Rated
Output Messenger 1.8.0
Aliexpress Clone- Ec21 Script 1
Indiegogo Clone 3.0
Online Food Ordeing System 1.0
PHP Image Resize Script 1.0
Best Spotify Clone 1.0
Get Random Record Based on Weight 1.0.0
PHP Point of sale 10.0
Travel Portal Script 9.29
Magento Product Designer 1.0
OFOS - Just Eat Clone Script 1.0
PrestaShop Upload Images Module 1.2.1
Trading Software 1.2.4
Deals and Discounts Website Script 1.0.2
ADO.NET Provider for ExactTarget 1.0
Site Index for Scripts 1.0
File ID: 96559






Site Index for Scripts 1.0
Download Site Index for Scripts 1.0http://www.multipurposeweb.com/Report Error Link
License: Freeware
File Size: 10.0 KB
Downloads: 28
Submit Rating:
Site Index for Scripts 1.0 Description
Description: Site Index will spider website and extract all anchor links from all webpages. It can also extract titles and plain text.

URL Reduction

You might be astonished at how many ways there are to refer to the same location on the web. Here are just a few examples:
- http://www.domain.com/path/index.html
- http://www.domain.com/path/
- http://www.domain.com/path
- http://domain.com/path/index.html
The script will reduce such URLs to the same form so that only one link per webpage is indexed. It will optionally auto-append or strip www. prefix from domain name and auto-append or strip default filename index.* from url.

Query Strings

If you store session ids or some other random values in the query string the script will optionally remove them.

License: Freeware

Related: optionally, autoappend, strip, httpwwwdomaincompath, Script, Extract, Filename, Index, default, Domain, Website, Spider, prefix, urlquery, Store, Query, String, Remove, values, Random

O/S:Linux, Solaris, Mac OS X

File Size: 10.0 KB

Downloads: 28



More Similar Code

Chatologica Web-Site Accelerator for Apache helps in reducing of your outgoing traffic from a server and faster delivery of your static text web documents. It works only for web-sites hosted on Apache web server. The script modifies only the static web documents so that they could be transferred over network in a gzip compressed form, which is much faster and economic than a transfer in original plain form. When a browser like MS Internet...



TT Web Site Manager is a free general purpose database driven web application framework written in PHP, featuring support for multiple database servers.

It allows multiple web applications to be built and managed entirely on the fly...



Chipmunk Scripts is a site used for downloading PHP scripts and it has other categories like, Webmaster Directory which has entire scripts based in PHP, Perl, ASP, C & C++, Free Hosting, website promotion, dedicated hosting, javascript and...



This site has different scripts to download. It is a resource center for PHP based scripts. Available PHP resources are, honeymail, php mysqlgraph, site referrers, php alphawall etc., Programmers can post their codes into this site. Only members...



A site index script that lets users navigate through your site using a multi-level list, with categories and subcategories. It produces a list of links in a frame similar to the display of a file system in Windows Explorer. Users can expand and...



Features:

* Provides easy site navigation for your visitors.
* A variety of extra button sets are included.
* Simply copy, paste and upload...done!.
* Expandable - easily add or remove additional button links.
*...



The Taxonomy VTN module provides an index for vocabularies, terms and nodes just like those you find at the end of reference or technical books. It supports synonyms, terms, related terms, and parent/child relations. The root Taxonomy VTN path is...



BlogBlogs is the biggest brazilian index for blogs. This plugin is used to grab information about your site's visitors.

For every comment on your site the plugin checks if the user is registered at BlogBlogs and grabs all his/her info....



The book index generator generate the back-of-book index for Thai book automatically.



Bug/Feature tracking software for scripts. Currently includes Feature Suggestions, Popularity, Comments, Bug Tracking, Developers, Feature Information, News & Updates System, Member System and heaps more.

User Review for Site Index for Scripts
- required fields
     

Please enter text on the image