📄 overview-summary.html
字号:
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"><!--NewPage--><HTML><HEAD><!-- Generated by javadoc (build 1.5.0_07) on Sun May 06 18:00:12 GMT 2007 --><TITLE>Overview (Heritrix 1.12.1)</TITLE><META NAME="keywords" CONTENT="Overview, Heritrix 1.12.1"><LINK REL ="stylesheet" TYPE="text/css" HREF="stylesheet.css" TITLE="Style"><SCRIPT type="text/javascript">function windowTitle(){ parent.document.title="Overview (Heritrix 1.12.1)";}</SCRIPT><NOSCRIPT></NOSCRIPT></HEAD><BODY BGCOLOR="white" onload="windowTitle();"><!-- ========= START OF TOP NAVBAR ======= --><A NAME="navbar_top"><!-- --></A><A HREF="#skip-navbar_top" title="Skip navigation links"></A><TABLE BORDER="0" WIDTH="100%" CELLPADDING="1" CELLSPACING="0" SUMMARY=""><TR><TD COLSPAN=2 BGCOLOR="#EEEEFF" CLASS="NavBarCell1"><A NAME="navbar_top_firstrow"><!-- --></A><TABLE BORDER="0" CELLPADDING="0" CELLSPACING="3" SUMMARY=""> <TR ALIGN="center" VALIGN="top"> <TD BGCOLOR="#FFFFFF" CLASS="NavBarCell1Rev"> <FONT CLASS="NavBarFont1Rev"><B>Overview</B></FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Package</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Class</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Use</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="overview-tree.html"><FONT CLASS="NavBarFont1"><B>Tree</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="deprecated-list.html"><FONT CLASS="NavBarFont1"><B>Deprecated</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="index-all.html"><FONT CLASS="NavBarFont1"><B>Index</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="help-doc.html"><FONT CLASS="NavBarFont1"><B>Help</B></FONT></A> </TD> </TR></TABLE></TD><TD ALIGN="right" VALIGN="top" ROWSPAN=3><EM></EM></TD></TR><TR><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> PREV NEXT</FONT></TD><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> <A HREF="index.html?overview-summary.html" target="_top"><B>FRAMES</B></A> <A HREF="overview-summary.html" target="_top"><B>NO FRAMES</B></A> <SCRIPT type="text/javascript"> <!-- if(window==top) { document.writeln('<A HREF="allclasses-noframe.html"><B>All Classes</B></A>'); } //--></SCRIPT><NOSCRIPT> <A HREF="allclasses-noframe.html"><B>All Classes</B></A></NOSCRIPT></FONT></TD></TR></TABLE><A NAME="skip-navbar_top"></A><!-- ========= END OF TOP NAVBAR ========= --><HR><CENTER><H1>Heritrix 1.12.1</H1></CENTER>Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.<P><B>See:</B><BR> <A HREF="#overview_description"><B>Description</B></A><P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2"><B>Packages</B></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/package-summary.html">org.archive.crawler</A></B></TD><TD>Introduction to Heritrix.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/admin/package-summary.html">org.archive.crawler.admin</A></B></TD><TD>Contains classes that the web UI uses to monitor and control crawls.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/admin/ui/package-summary.html">org.archive.crawler.admin.ui</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/datamodel/package-summary.html">org.archive.crawler.datamodel</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/datamodel/credential/package-summary.html">org.archive.crawler.datamodel.credential</A></B></TD><TD>Contains html form login and basic and digest credentialsused by Heritrix logging into sites.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/deciderules/package-summary.html">org.archive.crawler.deciderules</A></B></TD><TD>Provides classes for a simple decision rules framework.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/deciderules/recrawl/package-summary.html">org.archive.crawler.deciderules.recrawl</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/event/package-summary.html">org.archive.crawler.event</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/extractor/package-summary.html">org.archive.crawler.extractor</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/fetcher/package-summary.html">org.archive.crawler.fetcher</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/filter/package-summary.html">org.archive.crawler.filter</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/framework/package-summary.html">org.archive.crawler.framework</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/framework/exceptions/package-summary.html">org.archive.crawler.framework.exceptions</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/frontier/package-summary.html">org.archive.crawler.frontier</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/io/package-summary.html">org.archive.crawler.io</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/postprocessor/package-summary.html">org.archive.crawler.postprocessor</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/prefetch/package-summary.html">org.archive.crawler.prefetch</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/processor/package-summary.html">org.archive.crawler.processor</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/processor/recrawl/package-summary.html">org.archive.crawler.processor.recrawl</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/scope/package-summary.html">org.archive.crawler.scope</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/selftest/package-summary.html">org.archive.crawler.selftest</A></B></TD><TD>Provides the client-side aspect of the heritrix integration self test.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/settings/package-summary.html">org.archive.crawler.settings</A></B></TD><TD>Provides classes for the settings framework.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/settings/refinements/package-summary.html">org.archive.crawler.settings.refinements</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/url/package-summary.html">org.archive.crawler.url</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/url/canonicalize/package-summary.html">org.archive.crawler.url.canonicalize</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/util/package-summary.html">org.archive.crawler.util</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/crawler/writer/package-summary.html">org.archive.crawler.writer</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/extractor/package-summary.html">org.archive.extractor</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/httpclient/package-summary.html">org.archive.httpclient</A></B></TD><TD>Provides specializations on apache <a href="http://jakarta.apache.org/commons/httpclient/">jakarta commons httpclient</a>.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/io/package-summary.html">org.archive.io</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/io/arc/package-summary.html">org.archive.io.arc</A></B></TD><TD>ARC file reading and writing.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/io/warc/package-summary.html">org.archive.io.warc</A></B></TD><TD>Experimental WARC Writer and Readers.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/io/warc/v10/package-summary.html">org.archive.io.warc.v10</A></B></TD><TD>Experimental WARC Writer and Readers.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/net/package-summary.html">org.archive.net</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/net/md5/package-summary.html">org.archive.net.md5</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/net/rsync/package-summary.html">org.archive.net.rsync</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/net/s3/package-summary.html">org.archive.net.s3</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/queue/package-summary.html">org.archive.queue</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/uid/package-summary.html">org.archive.uid</A></B></TD><TD>A unique ID generator.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/package-summary.html">org.archive.util</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/anvl/package-summary.html">org.archive.util.anvl</A></B></TD><TD>Parsers and Writers for the (expired) Internet-Draft <a href="http://www.cdlib.org/inside/diglib/ark/anvlspec.pdf">A Name-ValueLanguage (ANVL)</a>.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/bdbje/package-summary.html">org.archive.util.bdbje</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/fingerprint/package-summary.html">org.archive.util.fingerprint</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/iterator/package-summary.html">org.archive.util.iterator</A></B></TD><TD> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD WIDTH="20%"><B><A HREF="org/archive/util/ms/package-summary.html">org.archive.util.ms</A></B></TD><TD>Memory-efficient reading of .doc files.</TD></TR></TABLE><P> <A NAME="overview_description"><!-- --></A><P>Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Browse to <A HREF="org/archive/crawler/package-summary.html"><CODE>org.archive.crawler</CODE></A> to find the entrance to the heritrix javadoc. <p>The Heritrix project is hosted by <a href="http://www.sourceforge.net">sourceforge.net</a> at <a href="http://crawler.archive.org">crawler.archive.org</a>. </p><P><P><HR><!-- ======= START OF BOTTOM NAVBAR ====== --><A NAME="navbar_bottom"><!-- --></A><A HREF="#skip-navbar_bottom" title="Skip navigation links"></A><TABLE BORDER="0" WIDTH="100%" CELLPADDING="1" CELLSPACING="0" SUMMARY=""><TR><TD COLSPAN=2 BGCOLOR="#EEEEFF" CLASS="NavBarCell1"><A NAME="navbar_bottom_firstrow"><!-- --></A><TABLE BORDER="0" CELLPADDING="0" CELLSPACING="3" SUMMARY=""> <TR ALIGN="center" VALIGN="top"> <TD BGCOLOR="#FFFFFF" CLASS="NavBarCell1Rev"> <FONT CLASS="NavBarFont1Rev"><B>Overview</B></FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Package</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Class</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Use</FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="overview-tree.html"><FONT CLASS="NavBarFont1"><B>Tree</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="deprecated-list.html"><FONT CLASS="NavBarFont1"><B>Deprecated</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="index-all.html"><FONT CLASS="NavBarFont1"><B>Index</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="help-doc.html"><FONT CLASS="NavBarFont1"><B>Help</B></FONT></A> </TD> </TR></TABLE></TD><TD ALIGN="right" VALIGN="top" ROWSPAN=3><EM></EM></TD></TR><TR><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> PREV NEXT</FONT></TD><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> <A HREF="index.html?overview-summary.html" target="_top"><B>FRAMES</B></A> <A HREF="overview-summary.html" target="_top"><B>NO FRAMES</B></A> <SCRIPT type="text/javascript"> <!-- if(window==top) { document.writeln('<A HREF="allclasses-noframe.html"><B>All Classes</B></A>'); } //--></SCRIPT><NOSCRIPT> <A HREF="allclasses-noframe.html"><B>All Classes</B></A></NOSCRIPT></FONT></TD></TR></TABLE><A NAME="skip-navbar_bottom"></A><!-- ======== END OF BOTTOM NAVBAR ======= --><HR>Copyright © 2003-2007 Internet Archive. All Rights Reserved.</BODY></HTML>⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -