candidateuri.html
来自「网络爬虫开源代码」· HTML 代码 · 共 929 行 · 第 1/4 页
HTML
929 行
<TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected java.lang.String</CODE></FONT></TD><TD><CODE><B>AbstractFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AbstractFrontier.html#canonicalize(org.archive.crawler.datamodel.CandidateURI)">canonicalize</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Canonicalize passed CandidateURI.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected java.lang.String</CODE></FONT></TD><TD><CODE><B>AdaptiveRevisitFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AdaptiveRevisitFrontier.html#canonicalize(org.archive.crawler.datamodel.CandidateURI)">canonicalize</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Canonicalize passed CandidateURI.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>AbstractFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AbstractFrontier.html#getClassKey(org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>AdaptiveRevisitFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AdaptiveRevisitFrontier.html#getClassKey(org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>IPQueueAssignmentPolicy.</B><B><A HREF="../../../../../org/archive/crawler/frontier/IPQueueAssignmentPolicy.html#getClassKey(org.archive.crawler.framework.CrawlController, org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/framework/CrawlController.html" title="class in org.archive.crawler.framework">CrawlController</A> controller, <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>SurtAuthorityQueueAssignmentPolicy.</B><B><A HREF="../../../../../org/archive/crawler/frontier/SurtAuthorityQueueAssignmentPolicy.html#getClassKey(org.archive.crawler.framework.CrawlController, org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/framework/CrawlController.html" title="class in org.archive.crawler.framework">CrawlController</A> controller, <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>abstract java.lang.String</CODE></FONT></TD><TD><CODE><B>QueueAssignmentPolicy.</B><B><A HREF="../../../../../org/archive/crawler/frontier/QueueAssignmentPolicy.html#getClassKey(org.archive.crawler.framework.CrawlController, org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/framework/CrawlController.html" title="class in org.archive.crawler.framework">CrawlController</A> controller, <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Get the String key (name) of the queue to which the CrawlURI should be assigned.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>BucketQueueAssignmentPolicy.</B><B><A HREF="../../../../../org/archive/crawler/frontier/BucketQueueAssignmentPolicy.html#getClassKey(org.archive.crawler.framework.CrawlController, org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/framework/CrawlController.html" title="class in org.archive.crawler.framework">CrawlController</A> controller, <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> curi)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> java.lang.String</CODE></FONT></TD><TD><CODE><B>HostnameQueueAssignmentPolicy.</B><B><A HREF="../../../../../org/archive/crawler/frontier/HostnameQueueAssignmentPolicy.html#getClassKey(org.archive.crawler.framework.CrawlController, org.archive.crawler.datamodel.CandidateURI)">getClassKey</A></B>(<A HREF="../../../../../org/archive/crawler/framework/CrawlController.html" title="class in org.archive.crawler.framework">CrawlController</A> controller, <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected void</CODE></FONT></TD><TD><CODE><B>AdaptiveRevisitFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AdaptiveRevisitFrontier.html#innerSchedule(org.archive.crawler.datamodel.CandidateURI)">innerSchedule</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> void</CODE></FONT></TD><TD><CODE><B>WorkQueueFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/WorkQueueFrontier.html#receive(org.archive.crawler.datamodel.CandidateURI)">receive</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> Accept the given CandidateURI for scheduling, as it has passed the alreadyIncluded filter.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> void</CODE></FONT></TD><TD><CODE><B>AdaptiveRevisitFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AdaptiveRevisitFrontier.html#receive(org.archive.crawler.datamodel.CandidateURI)">receive</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> item)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> void</CODE></FONT></TD><TD><CODE><B>WorkQueueFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/WorkQueueFrontier.html#schedule(org.archive.crawler.datamodel.CandidateURI)">schedule</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> Arrange for the given CandidateURI to be visited, if it is not already scheduled/completed.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE> void</CODE></FONT></TD><TD><CODE><B>AdaptiveRevisitFrontier.</B><B><A HREF="../../../../../org/archive/crawler/frontier/AdaptiveRevisitFrontier.html#schedule(org.archive.crawler.datamodel.CandidateURI)">schedule</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caURI)</CODE><BR> </TD></TR></TABLE> <P><A NAME="org.archive.crawler.postprocessor"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> in <A HREF="../../../../../org/archive/crawler/postprocessor/package-summary.html">org.archive.crawler.postprocessor</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Methods in <A HREF="../../../../../org/archive/crawler/postprocessor/package-summary.html">org.archive.crawler.postprocessor</A> with parameters of type <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected boolean</CODE></FONT></TD><TD><CODE><B>SupplementaryLinksScoper.</B><B><A HREF="../../../../../org/archive/crawler/postprocessor/SupplementaryLinksScoper.html#isInScope(org.archive.crawler.datamodel.CandidateURI)">isInScope</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected void</CODE></FONT></TD><TD><CODE><B>SupplementaryLinksScoper.</B><B><A HREF="../../../../../org/archive/crawler/postprocessor/SupplementaryLinksScoper.html#outOfScope(org.archive.crawler.datamodel.CandidateURI)">outOfScope</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> Called when a CandidateUri is ruled out of scope.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected void</CODE></FONT></TD><TD><CODE><B>LinksScoper.</B><B><A HREF="../../../../../org/archive/crawler/postprocessor/LinksScoper.html#outOfScope(org.archive.crawler.datamodel.CandidateURI)">outOfScope</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected void</CODE></FONT></TD><TD><CODE><B>FrontierScheduler.</B><B><A HREF="../../../../../org/archive/crawler/postprocessor/FrontierScheduler.html#schedule(org.archive.crawler.datamodel.CandidateURI)">schedule</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> caUri)</CODE><BR> Schedule the given <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel"><CODE>CandidateURI</CODE></A> with the Frontier.</TD></TR></TABLE> <P><A NAME="org.archive.crawler.processor"><!-- --></A><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableHeadingColor"><TH ALIGN="left" COLSPAN="2"><FONT SIZE="+2">Uses of <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> in <A HREF="../../../../../org/archive/crawler/processor/package-summary.html">org.archive.crawler.processor</A></FONT></TH></TR></TABLE> <P><TABLE BORDER="1" WIDTH="100%" CELLPADDING="3" CELLSPACING="0" SUMMARY=""><TR BGCOLOR="#CCCCFF" CLASS="TableSubHeadingColor"><TH ALIGN="left" COLSPAN="2">Methods in <A HREF="../../../../../org/archive/crawler/processor/package-summary.html">org.archive.crawler.processor</A> with parameters of type <A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A></FONT></TH></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected boolean</CODE></FONT></TD><TD><CODE><B>CrawlMapper.</B><B><A HREF="../../../../../org/archive/crawler/processor/CrawlMapper.html#decideToMapOutlink(org.archive.crawler.datamodel.CandidateURI)">decideToMapOutlink</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> </TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected void</CODE></FONT></TD><TD><CODE><B>CrawlMapper.</B><B><A HREF="../../../../../org/archive/crawler/processor/CrawlMapper.html#divertLog(org.archive.crawler.datamodel.CandidateURI, java.lang.String)">divertLog</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri, java.lang.String target)</CODE><BR> Note the given CandidateURI in the appropriate diversion log.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected java.lang.String</CODE></FONT></TD><TD><CODE><B>HashCrawlMapper.</B><B><A HREF="../../../../../org/archive/crawler/processor/HashCrawlMapper.html#map(org.archive.crawler.datamodel.CandidateURI)">map</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Look up the crawler node name to which the given CandidateURI should be mapped.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected abstract java.lang.String</CODE></FONT></TD><TD><CODE><B>CrawlMapper.</B><B><A HREF="../../../../../org/archive/crawler/processor/CrawlMapper.html#map(org.archive.crawler.datamodel.CandidateURI)">map</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Look up the crawler node name to which the given CandidateURI should be mapped.</TD></TR><TR BGCOLOR="white" CLASS="TableRowColor"><TD ALIGN="right" VALIGN="top" WIDTH="1%"><FONT SIZE="-1"><CODE>protected java.lang.String</CODE></FONT></TD><TD><CODE><B>LexicalCrawlMapper.</B><B><A HREF="../../../../../org/archive/crawler/processor/LexicalCrawlMapper.html#map(org.archive.crawler.datamodel.CandidateURI)">map</A></B>(<A HREF="../../../../../org/archive/crawler/datamodel/CandidateURI.html" title="class in org.archive.crawler.datamodel">CandidateURI</A> cauri)</CODE><BR> Look up the crawler node name to which the given CandidateURI should be mapped.</TD></TR></TABLE> <P>⌨️ 快捷键说明
复制代码Ctrl + C
搜索代码Ctrl + F
全屏模式F11
增大字号Ctrl + =
减小字号Ctrl + -
显示快捷键?