searchenginejournal.com.script

垂直搜索的网络爬虫

FIND_NODE	... <div class="post"> 	[GOTO_TASK	3][next]
FIND_NODE	... h1 class="storytitle"	[next][END_OF_DOCUMENT]
SAVE_POS	$post_start	[next][END_OF_DOCUMENT]
FIND_NODE	<h2> ...	[next][END_OF_DOCUMENT]
SAVE_TEXT	$date	-1	-1	[next][END_OF_DOCUMENT]
STORE_ISODATE	iso-date	MM/dd/yyyy	$date	[next][END_OF_DOCUMENT]
SET_POS	$post_start	[next][END_OF_DOCUMENT]
FIND_NODE	... h1 class="storytitle"	[next][END_OF_DOCUMENT]
STORE_TEXT	title	-1	-1	[next][END_OF_DOCUMENT]
FIND_NODE	... <div class="storycontent"> 	[next][END_OF_DOCUMENT]
STORE_TEXT	content	-1	-1	[next][END_OF_DOCUMENT]
STORE_LINKS	-1	-1	[next][END_OF_DOCUMENT]
END_OF_ARTICLE		[next][END_OF_DOCUMENT]
END_OF_DOCUMENT		[next][END_OF_DOCUMENT]