📄 moduletype.html
字号:
<TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorJS.html" title="class in org.archive.crawler.extractor">ExtractorJS</A></B></CODE><BR> Processes Javascript files for strings that are likely to be crawlable URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorPDF.html" title="class in org.archive.crawler.extractor">ExtractorPDF</A></B></CODE><BR> Allows the caller to process a CrawlURI representing a PDF for the purpose of extracting URIs</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorSWF.html" title="class in org.archive.crawler.extractor">ExtractorSWF</A></B></CODE><BR> Extracts URIs from SWF (flash/shockwave) files.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorUniversal.html" title="class in org.archive.crawler.extractor">ExtractorUniversal</A></B></CODE><BR> A last ditch extractor that will look at the raw byte code and try to extract anything that <i>looks</i> like a link.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorURI.html" title="class in org.archive.crawler.extractor">ExtractorURI</A></B></CODE><BR> An extractor for finding URIs inside other URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorXML.html" title="class in org.archive.crawler.extractor">ExtractorXML</A></B></CODE><BR> A simple extractor which finds HTTP URIs inside XML/RSS files, inside attribute values and simple elements (those with only whitespace + HTTP URI + whitespace as contents)</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/HTTPContentDigest.html" title="class in org.archive.crawler.extractor">HTTPContentDigest</A></B></CODE><BR> A processor for calculating custum HTTP content digests in place of the default (if any) computed by the HTTP fetcher processors.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.fetcher"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/fetcher/package-summary.html">org.archive.crawler.fetcher</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Subclasses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/fetcher/package-summary.html">org.archive.crawler.fetcher</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/fetcher/FetchDNS.html" title="class in org.archive.crawler.fetcher">FetchDNS</A></B></CODE><BR> Processor to resolve 'dns:' URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/fetcher/FetchFTP.html" title="class in org.archive.crawler.fetcher">FetchFTP</A></B></CODE><BR> Fetches documents and directory listings using FTP.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/fetcher/FetchHTTP.html" title="class in org.archive.crawler.fetcher">FetchHTTP</A></B></CODE><BR> HTTP fetcher that uses <a href="http://jakarta.apache.org/commons/httpclient/">Apache Jakarta Commons HttpClient</a> library.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.filter"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/filter/package-summary.html">org.archive.crawler.filter</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Subclasses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/filter/package-summary.html">org.archive.crawler.filter</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/ContentTypeRegExpFilter.html" title="class in org.archive.crawler.filter">ContentTypeRegExpFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. To be replaced by an equivalent <CODE>DecideRule</CODE>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/FilePatternFilter.html" title="class in org.archive.crawler.filter">FilePatternFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <CODE>MatchesFilePatternDecideRule</CODE>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/HopsFilter.html" title="class in org.archive.crawler.filter">HopsFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <CODE>DecidingFilter</CODE> and equivalent <CODE>DecideRule</CODE>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/HTTPMidFetchUnchangedFilter.html" title="class in org.archive.crawler.filter">HTTPMidFetchUnchangedFilter</A></B></CODE><BR> A mid fetch filter for HTTP fetcher processors.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/OrFilter.html" title="class in org.archive.crawler.filter">OrFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/PathDepthFilter.html" title="class in org.archive.crawler.filter">PathDepthFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/PathologicalPathFilter.html" title="class in org.archive.crawler.filter">PathologicalPathFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/SurtPrefixFilter.html" title="class in org.archive.crawler.filter">SurtPrefixFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/TransclusionFilter.html" title="class in org.archive.crawler.filter">TransclusionFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/URIListRegExpFilter.html" title="class in org.archive.crawler.filter">URIListRegExpFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/filter/URIRegExpFilter.html" title="class in org.archive.crawler.filter">URIRegExpFilter</A></B></CODE><BR> <B>Deprecated.</B> <I>As of release 1.10.0. Replaced by <A HREF="../../../../../org/archive/crawler/deciderules/DecidingFilter.html" title="class in org.archive.crawler.deciderules"><CODE>DecidingFilter</CODE></A> and equivalent <A HREF="../../../../../org/archive/crawler/deciderules/DecideRule.html" title="class in org.archive.crawler.deciderules"><CODE>DecideRule</CODE></A>.</I></TD></TR></TABLE> <P><A NAME="org.archive.crawler.framework"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/framework/package-summary.html">org.archive.crawler.framework</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Subclasses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/framework/package-summary.html">org.archive.crawler.framework</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor">⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -