traffick.com.script~2

垂直搜索的网络爬虫

FIND_NODE	... <span class="header"> 	[next][END_OF_DOCUMENT]
STORE_TEXT	title	-1	-1	[next][END_OF_DOCUMENT]
FIND_NODE	... <span class="byline"> 	[next][END_OF_DOCUMENT]
SAVE_TEXT	$meta	-1	-1	[next][END_OF_DOCUMENT]
STORE_NODE	meta	$meta	[next][END_OF_DOCUMENT]
REGEXP	$meta	/(.+),\s+(.+)/	[next][END_OF_DOCUMENT]
STORE_ISODATE	iso-date	MM/dd/yyyy	$2	[next][END_OF_DOCUMENT]
FIND_NODE	... </span class="byline">	[next][END_OF_DOCUMENT]
SAVE_POS	$content_start	[next][END_OF_DOCUMENT]
FIND_NODE	... hr	[next][END_OF_DOCUMENT]
SAVE_POS	$content_end	[next][END_OF_DOCUMENT]
STORE_TEXT	title	$content_start	$content_end	[next][END_OF_DOCUMENT]
STORE_LINKS	$content_start	$content_end	[next][END_OF_DOCUMENT]
END_OF_ARTICLE		[next][END_OF_DOCUMENT]
END_OF_DOCUMENT		[next][END_OF_DOCUMENT]