📄 package-use.html
字号:
<BR> Shared facilities for Frontier implementations.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/AdaptiveRevisitAttributeConstants.html#org.archive.crawler.frontier"><B>AdaptiveRevisitAttributeConstants</B></A></B><BR> Defines static constants for the Adaptive Revisiting module defining data keys in the CrawlURI AList.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/AdaptiveRevisitHostQueue.html#org.archive.crawler.frontier"><B>AdaptiveRevisitHostQueue</B></A></B><BR> A priority based queue of CrawlURIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/AdaptiveRevisitQueueList.html#org.archive.crawler.frontier"><B>AdaptiveRevisitQueueList</B></A></B><BR> Maintains an ordered list of <A HREF="../../../../org/archive/crawler/frontier/AdaptiveRevisitHostQueue.html" title="class in org.archive.crawler.frontier"><CODE>AdaptiveRevisitHostQueue</CODE></A>s used by a Frontier.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/BdbFrontier.html#org.archive.crawler.frontier"><B>BdbFrontier</B></A></B><BR> A Frontier using several BerkeleyDB JE Databases to hold its record of known hosts (queues), and pending URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/BdbMultipleWorkQueues.html#org.archive.crawler.frontier"><B>BdbMultipleWorkQueues</B></A></B><BR> A BerkeleyDB-database-backed structure for holding ordered groupings of CrawlURIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/CostAssignmentPolicy.html#org.archive.crawler.frontier"><B>CostAssignmentPolicy</B></A></B><BR> Calculate a integer 'cost' value for the given CrawlURI.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/FrontierJournal.html#org.archive.crawler.frontier"><B>FrontierJournal</B></A></B><BR> Record of key Frontier happenings.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/HostnameQueueAssignmentPolicy.html#org.archive.crawler.frontier"><B>HostnameQueueAssignmentPolicy</B></A></B><BR> QueueAssignmentPolicy based on the hostname:port evident in the given CrawlURI.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/QueueAssignmentPolicy.html#org.archive.crawler.frontier"><B>QueueAssignmentPolicy</B></A></B><BR> Establishes a mapping from CrawlURIs to String keys (queue names).</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/WagCostAssignmentPolicy.html#org.archive.crawler.frontier"><B>WagCostAssignmentPolicy</B></A></B><BR> A CostAssignmentPolicy based on some wild guesses of kinds of URIs that should be deferred into the (potentially never-crawled) future.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/WorkQueue.html#org.archive.crawler.frontier"><B>WorkQueue</B></A></B><BR> A single queue of related URIs to visit, grouped by a classKey (typically "hostname:port" or similar)</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/WorkQueueFrontier.html#org.archive.crawler.frontier"><B>WorkQueueFrontier</B></A></B><BR> A common Frontier base using several queues to hold pending URIs.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/WorkQueueFrontier.WakeTask.html#org.archive.crawler.frontier"><B>WorkQueueFrontier.WakeTask</B></A></B><BR> </TD></TR></TABLE> <P><A NAME="org.archive.crawler.postprocessor"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Classes in <A HREF="../../../../org/archive/crawler/frontier/package-summary.html">org.archive.crawler.frontier</A> used by <A HREF="../../../../org/archive/crawler/postprocessor/package-summary.html">org.archive.crawler.postprocessor</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD><B><A HREF="../../../../org/archive/crawler/frontier/class-use/AdaptiveRevisitAttributeConstants.html#org.archive.crawler.postprocessor"><B>AdaptiveRevisitAttributeConstants</B></A></B><BR> Defines static constants for the Adaptive Revisiting module defining data keys in the CrawlURI AList.</TD></TR></TABLE> <P><HR><!-- ======= START OF BOTTOM NAVBAR ====== --><A NAME="navbar_bottom"><!-- --></A><A HREF="#skip-navbar_bottom" title="Skip navigation links"></A><TABLE BORDER="0" WIDTH="100%" CELLPADDING="1" CELLSPACING="0" SUMMARY=""><TR><TD COLSPAN=2 BGCOLOR="#EEEEFF" CLASS="NavBarCell1"><A NAME="navbar_bottom_firstrow"><!-- --></A><TABLE BORDER="0" CELLPADDING="0" CELLSPACING="3" SUMMARY=""> <TR ALIGN="center" VALIGN="top"> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="../../../../overview-summary.html"><FONT CLASS="NavBarFont1"><B>Overview</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="package-summary.html"><FONT CLASS="NavBarFont1"><B>Package</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <FONT CLASS="NavBarFont1">Class</FONT> </TD> <TD BGCOLOR="#FFFFFF" CLASS="NavBarCell1Rev"> <FONT CLASS="NavBarFont1Rev"><B>Use</B></FONT> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="package-tree.html"><FONT CLASS="NavBarFont1"><B>Tree</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="../../../../deprecated-list.html"><FONT CLASS="NavBarFont1"><B>Deprecated</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="../../../../index-all.html"><FONT CLASS="NavBarFont1"><B>Index</B></FONT></A> </TD> <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1"> <A HREF="../../../../help-doc.html"><FONT CLASS="NavBarFont1"><B>Help</B></FONT></A> </TD> </TR></TABLE></TD><TD ALIGN="right" VALIGN="top" ROWSPAN=3><EM></EM></TD></TR><TR><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> PREV NEXT</FONT></TD><TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2"> <A HREF="../../../../index.html?org/archive/crawler/frontier/package-use.html" target="_top"><B>FRAMES</B></A> <A HREF="package-use.html" target="_top"><B>NO FRAMES</B></A> <SCRIPT type="text/javascript"> <!-- if(window==top) { document.writeln('<A HREF="../../../../allclasses-noframe.html"><B>All Classes</B></A>'); } //--></SCRIPT><NOSCRIPT> <A HREF="../../../../allclasses-noframe.html"><B>All Classes</B></A></NOSCRIPT></FONT></TD></TR></TABLE><A NAME="skip-navbar_bottom"></A><!-- ======== END OF BOTTOM NAVBAR ======= --><HR>Copyright © 2003-2006 Internet Archive. All Rights Reserved.</BODY></HTML>
⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -