type.html
来自「网络爬虫开源代码」· HTML 代码 · 共 1,176 行 · 第 1/5 页
HTML
1,176 行
<CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/MatchesListRegExpDecideRule.html" title="class in org.archive.crawler.deciderules">MatchesListRegExpDecideRule</A></B></CODE><BR> Rule applies configured decision to any CrawlURIs whose String URI matches the supplied regexps.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/MatchesRegExpDecideRule.html" title="class in org.archive.crawler.deciderules">MatchesRegExpDecideRule</A></B></CODE><BR> Rule applies configured decision to any CrawlURIs whose String URI matches the supplied regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotExceedsDocumentLengthTresholdDecideRule.html" title="class in org.archive.crawler.deciderules">NotExceedsDocumentLengthTresholdDecideRule</A></B></CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotMatchesFilePatternDecideRule.html" title="class in org.archive.crawler.deciderules">NotMatchesFilePatternDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs which do *not* match the supplied (file-pattern) regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotMatchesListRegExpDecideRule.html" title="class in org.archive.crawler.deciderules">NotMatchesListRegExpDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs which do *not* match the supplied regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotMatchesRegExpDecideRule.html" title="class in org.archive.crawler.deciderules">NotMatchesRegExpDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs which do *not* match the supplied regexp.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotOnDomainsDecideRule.html" title="class in org.archive.crawler.deciderules">NotOnDomainsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are *not* in one of the domains in the configured set of domains, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotOnHostsDecideRule.html" title="class in org.archive.crawler.deciderules">NotOnHostsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are *not* on one of the hosts in the configured set of hosts, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/NotSurtPrefixedDecideRule.html" title="class in org.archive.crawler.deciderules">NotSurtPrefixedDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that, when expressed in SURT form, do *not* begin with one of the prefixes in the configured set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/OnDomainsDecideRule.html" title="class in org.archive.crawler.deciderules">OnDomainsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are on one of the domains in the configured set of domains, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/OnHostsDecideRule.html" title="class in org.archive.crawler.deciderules">OnHostsDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that are on one of the hosts in the configured set of hosts, filled from the seed set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PathologicalPathDecideRule.html" title="class in org.archive.crawler.deciderules">PathologicalPathDecideRule</A></B></CODE><BR> Rule REJECTs any URI which contains an excessive number of identical, consecutive path-segments (eg http://example.com/a/a/a/boo.html == 3 '/a' segments)</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PredicatedDecideRule.html" title="class in org.archive.crawler.deciderules">PredicatedDecideRule</A></B></CODE><BR> Rule which applies the configured decision only if a test evaluates to true.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/PrerequisiteAcceptDecideRule.html" title="class in org.archive.crawler.deciderules">PrerequisiteAcceptDecideRule</A></B></CODE><BR> Rule which ACCEPTs all 'prerequisite' URIs (those with a 'P' in the last hopsPath position).</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/RejectDecideRule.html" title="class in org.archive.crawler.deciderules">RejectDecideRule</A></B></CODE><BR> Rule which answers REJECT to everything evaluated.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/ScopePlusOneDecideRule.html" title="class in org.archive.crawler.deciderules">ScopePlusOneDecideRule</A></B></CODE><BR> Rule allows one level of discovery beyond configured scope (e.g.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/SeedAcceptDecideRule.html" title="class in org.archive.crawler.deciderules">SeedAcceptDecideRule</A></B></CODE><BR> Rule which ACCEPTs all 'seed' URIs (those for which isSeed is true).</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/SurtPrefixedDecideRule.html" title="class in org.archive.crawler.deciderules">SurtPrefixedDecideRule</A></B></CODE><BR> Rule applies configured decision to any URIs that, when expressed in SURT form, begin with one of the prefixes in the configured set.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TooManyHopsDecideRule.html" title="class in org.archive.crawler.deciderules">TooManyHopsDecideRule</A></B></CODE><BR> Rule REJECTs any CrawlURIs whose total number of hops (length of the hopsPath string, traversed links of any type) is over a threshold.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TooManyPathSegmentsDecideRule.html" title="class in org.archive.crawler.deciderules">TooManyPathSegmentsDecideRule</A></B></CODE><BR> Rule REJECTs any CrawlURIs whose total number of path-segments (as indicated by the count of '/' characters not including the first '//') is over a given threshold.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/TransclusionDecideRule.html" title="class in org.archive.crawler.deciderules">TransclusionDecideRule</A></B></CODE><BR> Rule ACCEPTs any CrawlURIs whose path-from-seed ('hopsPath' -- see <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html#getPathFromSeed()"><CODE>CandidateURI.getPathFromSeed()</CODE></A>) ends with at least one, but not more than, the given number of non-navlink ('L') hops.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.deciderules.recrawl"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/Type.html" title="class in org.archive.crawler.settings">Type</A> in <A HREF="../../../../../org/archive/crawler/deciderules/recrawl/package-summary.html">org.archive.crawler.deciderules.recrawl</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Subclasses of <A HREF="../../../../../org/archive/crawler/settings/Type.html" title="class in org.archive.crawler.settings">Type</A> in <A HREF="../../../../../org/archive/crawler/deciderules/recrawl/package-summary.html">org.archive.crawler.deciderules.recrawl</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> class</CODE></FONT></TD><TD><CODE><B><A HREF="../../../../../org/archive/crawler/deciderules/recrawl/IdenticalDigestDecideRule.html" title="class in org.archive.crawler.deciderules.recrawl">IdenticalDigestDecideRule</A></B></CODE><BR> Rule applies configured decision to any CrawlURIs whose prior-history content-digest matches the latest fetch.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.extractor"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/settings/Type.html" title="class in org.archive.crawler.settings">Type</A> in <A HREF="../../../../../org/archive/crawler/extractor/package-summary.html">org.archive.crawler.extractor</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor">⌨️ 快捷键说明
复制代码Ctrl + C
搜索代码Ctrl + F
全屏模式F11
增大字号Ctrl + =
减小字号Ctrl + -
显示快捷键?