I have a huge webpage (over 300kb of just links) and what I want to be able to do is parse just pieces of the big page onto a template or another page. Basically I want to be able to put comments or anchors or something in the big HTML file to tell a CGI parsing script where to start parsing and where to stop parsing. Not only do I want it to be able to do that, I want it to work with variables. Being able to parse Part A or Part B not the entire page. I have found many scripts that use CGI and SSI to parse entire webpages, but I can't find anything that will parse customly defined parts of a page. Is this possible to do? If so, somebody please point me in the right direction of a script that already accomplishes this, or some code that I could use to start writing a script like this.

To help you visualize what I want to do....I want to use a CGI script to parse out different parts of this (www.smasonline.com/lyrics/list.html) lyrics page. So I can divide it into sections for each letter of the alaphbet.

If you could help me I would be forever greatful.

Thanks in advance,
Sancho

What you could do is something like this:
(not guarenteed to work and youd definately have to test it)

#!/usr/bin/perl

use LWP; # not sure if this is correct ... maybe LWP::Simple;

$addr = "http://www.somewhere.com/";

$html = get("$addr");

@data = split(/\n/,$html);

foreach (@data) {
if ($_ =~ //gis) {
if ($1 eq "LIST START") {
$start_typing = "true";
} elsif ($1 eq "LIST END") {
$start_typing = "false";
}
}
if ($start_typing eq "true") {
print $_;
}
}

Note: you have to put a comment (eg:  and ) where the content or links start.