news.com.com.script

垂直搜索的网络爬虫

FIND_NODE	... <div id="newsContent">	[next][END_OF_DOCUMENT]
FIND_NODE	... <h1>	[next][END_OF_DOCUMENT]
STORE_TEXT	title	-1	-1	[next][END_OF_DOCUMENT]
FIND_NODE	... <div id="storyMeta">	[next][END_OF_DOCUMENT]
FIND_NODE	... <div id="byline">	[next][END_OF_DOCUMENT]
STORE_TEXT	author	-1	-1	[next][END_OF_DOCUMENT]
FIND_NODE	... <div id="published">	[next][END_OF_DOCUMENT]
SAVE_TEXT	$text_published	-1	-1	[next][END_OF_DOCUMENT]
STORE_ISODATE	iso-date	'Published:' MMMM dd',' yyyy',' hh:mm a z	$text_published	[next][END_OF_DOCUMENT]
FIND_NODE	... <p>	[next][END_OF_DOCUMENT]
SAVE_POS	$content_start	[next][END_OF_DOCUMENT]
FIND_NODE	... <div id="storyFoot">	[next][END_OF_DOCUMENT]
SAVE_POS	$content_end	[next][END_OF_DOCUMENT]
STORE_TEXT	content	$content_start	$content_end	[next][END_OF_DOCUMENT]
STORE_LINKS	$content_start	$content_end	[next][END_OF_DOCUMENT]
END_OF_ARTICLE		[next][END_OF_DOCUMENT]
END_OF_DOCUMENT		[next][END_OF_DOCUMENT]