1_6_0.html

来自「一个开源的网页爬虫一个开源的网页爬虫一个开源的网页爬虫一个开源的网页爬虫一个开源」· HTML 代码 · 共 32 行 · 第 1/3 页

        major contributor to early Heritrix OutOfMemoryError problems on 64bit 
        systems. A workaround is to cut  the assigned percentage by 1/3 to 1/2. 
        For example, change the 'bdb-cache-percent' setting to '40' or '30' 
        (instead of the default 60% when no value is set here).</p></div></div><div class="sect2" lang="en"><div class="titlepage"><div><div><h3 class="title"><a name="1_6_0_changes"></a>4.2.&nbsp;Changes</h3></div></div></div><div class="sect3" lang="en"><div class="titlepage"><div><div><h4 class="title"><a name="postselector"></a>4.2.1.&nbsp;Postselector</h4></div></div></div><p>The Postselector has been refactored out of existence. 
         Its responsibilities have been parcelled out to two new Processors:
         LinksScoper and FrontierScheduler. LinksScoper is responsible for
         scope checking of extracted links. FrontierScheduler does the
         scheduling of URIs with the Frontier.</p><p>This change was done to allow introduction of processors
         between scope checking and Frontier scheduling steps.</p><p>Because of this change, order files from 1.4.0 Heritrix or
         before will need to be updated -- Postselector references replaced
         by LinkScoper and FrontierScheduler references  -- before they