📄 moduletype.html
字号:
match the supplied regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotOnDomainsDecideRule.html" title="class in org.archive.crawler.deciderules">NotOnDomainsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are *not* in one of the domains in the configured set of domains, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotOnHostsDecideRule.html" title="class in org.archive.crawler.deciderules">NotOnHostsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are *not* on one of the hosts in the configured set of hosts, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotSurtPrefixedDecideRule.html" title="class in org.archive.crawler.deciderules">NotSurtPrefixedDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that, when expressed in SURT form, do *not* begin with one of the prefixes in the configured set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/OnDomainsDecideRule.html" title="class in org.archive.crawler.deciderules">OnDomainsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are on one of the domains in the configured set of domains, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/OnHostsDecideRule.html" title="class in org.archive.crawler.deciderules">OnHostsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are on one of the hosts in the configured set of hosts, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PathologicalPathDecideRule.html" title="class in org.archive.crawler.deciderules">PathologicalPathDecideRule</A></B></CODE><BR> Rule REJECTs any URI which contains an excessive number of identical, consecutive path-segments (eg http://example.com/a/a/a/boo.html == 3 '/a' segments)</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PredicatedDecideRule.html" title="class in org.archive.crawler.deciderules">PredicatedDecideRule</A></B></CODE><BR> Rule which applies the configured decision only if a test evaluates to true.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PrerequisiteAcceptDecideRule.html" title="class in org.archive.crawler.deciderules">PrerequisiteAcceptDecideRule</A></B></CODE><BR> Rule which ACCEPTs all 'prerequisite' URIs (those with a 'P' in the last hopsPath position).</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/RejectDecideRule.html" title="class in org.archive.crawler.deciderules">RejectDecideRule</A></B></CODE><BR> Rule which answers REJECT to everything evaluated.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/ScopePlusOneDecideRule.html" title="class in org.archive.crawler.deciderules">ScopePlusOneDecideRule</A></B></CODE><BR> Rule allows one level of discovery beyond configured scope (e.g.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/SeedAcceptDecideRule.html" title="class in org.archive.crawler.deciderules">SeedAcceptDecideRule</A></B></CODE><BR> Rule which ACCEPTs all 'seed' URIs (those for which isSeed is true).</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/SurtPrefixedDecideRule.html" title="class in org.archive.crawler.deciderules">SurtPrefixedDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that, when expressed in SURT form, begin with one of the prefixes in the configured set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TooManyHopsDecideRule.html" title="class in org.archive.crawler.deciderules">TooManyHopsDecideRule</A></B></CODE><BR> Rule REJECTs any CrawlURIs whose total number of hops (length of the hopsPath string, traversed links of any type) is over a threshold.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TooManyPathSegmentsDecideRule.html" title="class in org.archive.crawler.deciderules">TooManyPathSegmentsDecideRule</A></B></CODE><BR> Rule REJECTs any CrawlURIs whose total number of path-segments (as indicated by the count of '/' characters not including the first '//') is over a given threshold.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TransclusionDecideRule.html" title="class in org.archive.crawler.deciderules">TransclusionDecideRule</A></B></CODE><BR> Rule ACCEPTs any CrawlURIs whose path-from-seed ('hopsPath' -- see <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html#getPathFromSeed()"><CODE>CandidateURI.getPathFromSeed()</CODE></A>) ends with at least one, but not more than, the given number of non-navlink ('L') hops.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.extractor"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/extractor/package-summary.html">org.archive.crawler.extractor</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Subclasses of <A HREF="../../../../../org/archive/crawler/settings/ModuleType.html" title="class in org.archive.crawler.settings">ModuleType</A> in <A HREF="../../../../../org/archive/crawler/extractor/package-summary.html">org.archive.crawler.extractor</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/AggressiveExtractorHTML.html" title="class in org.archive.crawler.extractor">AggressiveExtractorHTML</A></B></CODE><BR> Extended version of ExtractorHTML with more aggressive javascript link extraction where javascript code is parsed first with general HTML tags regexp, and than by javascript speculative link regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ChangeEvaluator.html" title="class in org.archive.crawler.extractor">ChangeEvaluator</A></B></CODE><BR> This processor compares the CrawlURI's current <A HREF="../../../../../org/archive/crawler/datamodel/CrawlURI.html#getContentDigest()"><CODE>content digest</CODE></A> with the one from a previous crawl.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/Extractor.html" title="class in org.archive.crawler.extractor">Extractor</A></B></CODE><BR> Convenience shared superclass for Extractor Processors.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorCSS.html" title="class in org.archive.crawler.extractor">ExtractorCSS</A></B></CODE><BR> This extractor is parsing URIs from CSS type files.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorDOC.html" title="class in org.archive.crawler.extractor">ExtractorDOC</A></B></CODE><BR> This class allows the caller to extract href style links from word97-format word documents.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorHTML.html" title="class in org.archive.crawler.extractor">ExtractorHTML</A></B></CODE><BR> Basic link-extraction, from an HTML content-body, using regular expressions.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorHTTP.html" title="class in org.archive.crawler.extractor">ExtractorHTTP</A></B></CODE><BR> Extracts URIs from HTTP response headers.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/extractor/ExtractorImpliedURI.html" title="class in org.archive.crawler.extractor">ExtractorImpliedURI</A></B></CODE><BR> An extractor for finding 'implied' URIs inside other URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD>⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -