frontier.html

用JAVA编写的,在做实验的时候留下来的,本来想删的,但是传上来,大家分享吧

 <p>While the order returned is consistent, it does <i>not</i> have any
 explicit relation to the likely order in which they may be processed.

 <p><b>Warning:</b> It is unsafe to make changes to the frontier while
 this method is executing. The crawler should be in a paused state before
 invoking it.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>marker</CODE> - A marker specifing from what position in the Frontier the
            list should begin.<DD><CODE>numberOfMatches</CODE> - how many URIs to add at most to the list before returning it<DD><CODE>verbose</CODE> - if set to true the strings returned will contain additional
            information about each URI beyond their names.
<DT><B>Returns:</B><DD>a list of all pending URIs falling within the specification
            of the marker
<DT><B>Throws:</B>
<DD><CODE><A HREF="../../../../org/archive/crawler/framework/exceptions/InvalidFrontierMarkerException.html" title="class in org.archive.crawler.framework.exceptions">InvalidFrontierMarkerException</A></CODE> - when the
            <code>URIFronterMarker</code> does not match the internal
            state of the frontier. Tolerance for this can vary
            considerably from one URIFrontier implementation to the next.<DT><B>See Also:</B><DD><A HREF="../../../../org/archive/crawler/framework/FrontierMarker.html" title="interface in org.archive.crawler.framework"><CODE>FrontierMarker</CODE></A>, 
<A HREF="../../../../org/archive/crawler/framework/Frontier.html#getInitialMarker(java.lang.String, boolean)"><CODE>getInitialMarker(String, boolean)</CODE></A></DL>
</DD>
</DL>
<HR>

<A NAME="deleteURIs(java.lang.String)"><!-- --></A><H3>
deleteURIs</H3>
<PRE>
long <B>deleteURIs</B>(java.lang.String&nbsp;match)</PRE>
<DL>
<DD>Delete any URI that matches the given regular expression from the list
 of discovered and pending URIs. This does not prevent them from being
 rediscovered.

 <p>Any encountered URI that has not been successfully crawled, terminally
 failed, disregarded or is currently being processed is considered to be
 a pending URI.

 <p><b>Warning:</b> It is unsafe to make changes to the frontier while
 this method is executing. The crawler should be in a paused state before
 invoking it.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>match</CODE> - A regular expression, any URIs that matches it will be
              deleted.
<DT><B>Returns:</B><DD>The number of URIs deleted</DL>
</DD>
</DL>
<HR>

<A NAME="deleted(org.archive.crawler.datamodel.CrawlURI)"><!-- --></A><H3>
deleted</H3>
<PRE>
void <B>deleted</B>(<A HREF="../../../../org/archive/crawler/datamodel/CrawlURI.html" title="class in org.archive.crawler.datamodel">CrawlURI</A>&nbsp;curi)</PRE>
<DL>
<DD>Notify Frontier that a CrawlURI has been deleted outside of the
 normal next()/finished() lifecycle.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>curi</CODE> - Deleted CrawlURI.</DL>
</DD>
</DL>
<HR>

<A NAME="considerIncluded(org.archive.net.UURI)"><!-- --></A><H3>
considerIncluded</H3>
<PRE>
void <B>considerIncluded</B>(<A HREF="../../../../org/archive/net/UURI.html" title="class in org.archive.net">UURI</A>&nbsp;u)</PRE>
<DL>
<DD>Notify Frontier that it should consider the given UURI as if
 already scheduled.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>u</CODE> - UURI instance to add to the Already Included set.</DL>
</DD>
</DL>
<HR>

<A NAME="kickUpdate()"><!-- --></A><H3>
kickUpdate</H3>
<PRE>
void <B>kickUpdate</B>()</PRE>
<DL>
<DD>Notify Frontier that it should consider updating configuration
 info that may have changed in external files.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="pause()"><!-- --></A><H3>
pause</H3>
<PRE>
void <B>pause</B>()</PRE>
<DL>
<DD>Notify Frontier that it should not release any URIs, instead
 holding all threads, until instructed otherwise.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="unpause()"><!-- --></A><H3>
unpause</H3>
<PRE>
void <B>unpause</B>()</PRE>
<DL>
<DD>Resumes the release of URIs to crawl, allowing worker
 ToeThreads to proceed.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="terminate()"><!-- --></A><H3>
terminate</H3>
<PRE>
void <B>terminate</B>()</PRE>
<DL>
<DD>Notify Frontier that it should end the crawl, giving
 any worker ToeThread that askss for a next() an 
 EndedException.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="getFrontierJournal()"><!-- --></A><H3>
getFrontierJournal</H3>
<PRE>
<A HREF="../../../../org/archive/crawler/frontier/FrontierJournal.html" title="interface in org.archive.crawler.frontier">FrontierJournal</A> <B>getFrontierJournal</B>()</PRE>
<DL>
<DD><DL>
</DL>
</DD>
<DD><DL>

<DT><B>Returns:</B><DD>Return the instance of <A HREF="../../../../org/archive/crawler/frontier/FrontierJournal.html" title="interface in org.archive.crawler.frontier"><CODE>FrontierJournal</CODE></A> that
 this Frontier is using.  May be null if no journaling.</DL>
</DD>
</DL>
<HR>

<A NAME="getClassKey(org.archive.crawler.datamodel.CandidateURI)"><!-- --></A><H3>
getClassKey</H3>
<PRE>
java.lang.String <B>getClassKey</B>(<A HREF="../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A>&nbsp;cauri)</PRE>
<DL>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>cauri</CODE> - CandidateURI for which we're to calculate and
 set class key.
<DT><B>Returns:</B><DD>Classkey for <code>cauri</code>.</DL>
</DD>
</DL>
<HR>

<A NAME="loadSeeds()"><!-- --></A><H3>
loadSeeds</H3>
<PRE>
void <B>loadSeeds</B>()</PRE>
<DL>
<DD>Request that the Frontier load (or reload) crawl seeds, 
 typically by contacting the Scope.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="start()"><!-- --></A><H3>
start</H3>
<PRE>
void <B>start</B>()</PRE>
<DL>
<DD>Request that Frontier allow crawling to begin. Usually
 just unpauses Frontier, if paused.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
</DL>
</DD>
</DL>
<HR>

<A NAME="getGroup(org.archive.crawler.datamodel.CrawlURI)"><!-- --></A><H3>
getGroup</H3>
<PRE>
<A HREF="../../../../org/archive/crawler/framework/Frontier.FrontierGroup.html" title="interface in org.archive.crawler.framework">Frontier.FrontierGroup</A> <B>getGroup</B>(<A HREF="../../../../org/archive/crawler/datamodel/CrawlURI.html" title="class in org.archive.crawler.datamodel">CrawlURI</A>&nbsp;curi)</PRE>
<DL>
<DD>Get the 'frontier group' (usually queue) for the given 
 CrawlURI.
<P>
<DD><DL>
</DL>
</DD>
<DD><DL>
<DT><B>Parameters:</B><DD><CODE>curi</CODE> - CrawlURI to find matching group
<DT><B>Returns:</B><DD>FrontierGroup for the CrawlURI</DL>
</DD>
</DL>
<!-- ========= END OF CLASS DATA ========= -->
<HR>


<!-- ======= START OF BOTTOM NAVBAR ====== -->
<A NAME="navbar_bottom"><!-- --></A>
<A HREF="#skip-navbar_bottom" title="Skip navigation links"></A>
<TABLE BORDER="0" WIDTH="100%" CELLPADDING="1" CELLSPACING="0" SUMMARY="">
<TR>
<TD COLSPAN=2 BGCOLOR="#EEEEFF" CLASS="NavBarCell1">
<A NAME="navbar_bottom_firstrow"><!-- --></A>
<TABLE BORDER="0" CELLPADDING="0" CELLSPACING="3" SUMMARY="">
  <TR ALIGN="center" VALIGN="top">
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="../../../../overview-summary.html"><FONT CLASS="NavBarFont1"><B>Overview</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="package-summary.html"><FONT CLASS="NavBarFont1"><B>Package</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#FFFFFF" CLASS="NavBarCell1Rev"> &nbsp;<FONT CLASS="NavBarFont1Rev"><B>Class</B></FONT>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="class-use/Frontier.html"><FONT CLASS="NavBarFont1"><B>Use</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="package-tree.html"><FONT CLASS="NavBarFont1"><B>Tree</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="../../../../deprecated-list.html"><FONT CLASS="NavBarFont1"><B>Deprecated</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="../../../../index-all.html"><FONT CLASS="NavBarFont1"><B>Index</B></FONT></A>&nbsp;</TD>
  <TD BGCOLOR="#EEEEFF" CLASS="NavBarCell1">    <A HREF="../../../../help-doc.html"><FONT CLASS="NavBarFont1"><B>Help</B></FONT></A>&nbsp;</TD>
  </TR>
</TABLE>
</TD>
<TD ALIGN="right" VALIGN="top" ROWSPAN=3><EM>
</EM>
</TD>
</TR>

<TR>
<TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2">
&nbsp;<A HREF="../../../../org/archive/crawler/framework/Filter.html" title="class in org.archive.crawler.framework"><B>PREV CLASS</B></A>&nbsp;
&nbsp;<A HREF="../../../../org/archive/crawler/framework/Frontier.FrontierGroup.html" title="interface in org.archive.crawler.framework"><B>NEXT CLASS</B></A></FONT></TD>
<TD BGCOLOR="white" CLASS="NavBarCell2"><FONT SIZE="-2">
  <A HREF="../../../../index.html?org/archive/crawler/framework/Frontier.html" target="_top"><B>FRAMES</B></A>  &nbsp;
&nbsp;<A HREF="Frontier.html" target="_top"><B>NO FRAMES</B></A>  &nbsp;
&nbsp;<SCRIPT type="text/javascript">
  <!--
  if(window==top) {
    document.writeln('<A HREF="../../../../allclasses-noframe.html"><B>All Classes</B></A>');
  }
  //-->
</SCRIPT>
<NOSCRIPT>
  <A HREF="../../../../allclasses-noframe.html"><B>All Classes</B></A>
</NOSCRIPT>


</FONT></TD>
</TR>
<TR>
<TD VALIGN="top" CLASS="NavBarCell3"><FONT SIZE="-2">
  SUMMARY:&nbsp;<A HREF="#nested_class_summary">NESTED</A>&nbsp;|&nbsp;<A HREF="#field_summary">FIELD</A>&nbsp;|&nbsp;CONSTR&nbsp;|&nbsp;<A HREF="#method_summary">METHOD</A></FONT></TD>
<TD VALIGN="top" CLASS="NavBarCell3"><FONT SIZE="-2">
DETAIL:&nbsp;<A HREF="#field_detail">FIELD</A>&nbsp;|&nbsp;CONSTR&nbsp;|&nbsp;<A HREF="#method_detail">METHOD</A></FONT></TD>
</TR>
</TABLE>
<A NAME="skip-navbar_bottom"></A>
<!-- ======== END OF BOTTOM NAVBAR ======= -->

<HR>
Copyright &copy; 2003-2006 Internet Archive. All Rights Reserved.
</BODY>
</HTML>