searchenginejournal.blogspot.com.script

垂直搜索的网络爬虫

FIND_NODE	... <div class="Post">	[next][END_OF_DOCUMENT]
SAVE_POS	$post_start	[next][END_OF_DOCUMENT]
FIND_NODE	<div class="DateHeader"> ...	[next][END_OF_DOCUMENT]
SAVE_TEXT	$date	-1	-1	[next][END_OF_DOCUMENT]
STORE_ISODATE	iso-date	EEE, MMM dd, yyyy	$date	[next][END_OF_DOCUMENT]
SET_POS	$post_start	[next][END_OF_DOCUMENT]
STORE_TEXT	content	-1	-1	[next][END_OF_DOCUMENT]
STORE_LINKS	-1	-1	[next][END_OF_DOCUMENT]
FIND_NODE	... <span class="PostTitle"> 	[next][END_OF_DOCUMENT]
STORE_TEXT	title	-1	-1	[next][END_OF_DOCUMENT]
END_OF_ARTICLE		[next][END_OF_DOCUMENT]
GOTO_TASK	1	[][]