sports.tom.com.html

一个java+Mysql写的主题爬虫,可以通过给定初始的url爬取到相关的网页

<!-- 大考场1 -->
<ul id="exam_cont1" class="examlist">
<li><em><a href="http://test.sports.tom.com/test_j4457.html" target="_blank">测试这辈子你赚多少钱才算够花</a></em></li><li><em><a href="http://test.sports.tom.com/test_j4468.html" target="_blank">测你是别人眼里的“俗女”吗？</a></em></li><li><em><a href="http://test.sports.tom.com/test_j4464.html" target="_blank">回到古代你会变成什么气质的人</a></em></li><li><a href="http://test.sports.tom.com/test_j4470.html" target="_blank">测试你的性格基因和生命路线？</a></li><li><a href="http://test.sports.tom.com/test_s2637.html" target="_blank">一个很著名的人力资源测试题！</a></li><li><a href="http://test.sports.tom.com/test_s2641.html" target="_blank">手机使用习惯看你的人际关系！</a></li><li><a href="http://test.sports.tom.com/test_j4625.html" target="_blank">你身上什么地方最让男人着迷？</a></li><li><a href="http://test.sports.tom.com/test_j3593.html" target="_blank">测测你与生俱来的命运是什么？</a></li>								</ul>
<!-- 大考场1 -->
<!-- 大考场2 -->
<ul id="exam_cont2" class="examlist" style="display:none;">
<li><em><a href="http://test.sports.tom.com/test_j1029.html" target="_blank">测试你身体的什么部分最性感？</a></em></li><li><em><a href="http://test.sports.tom.com/test_j4486.html" target="_blank">不可思议的梦境看穿现在的你！</a></em></li><li><em><a href="http://test.sports.tom.com/test_j4487.html" target="_blank">测试你的“放电”等级有多高！</a></em></li><li><a href="http://test.sports.tom.com/test_j4497.html" target="_blank">测测你到底有什么未知的天赋？</a></li><li><a href="http://test.sports.tom.com/test_j4615.html" target="_blank">你的内在个性属于哪种卡通人物</a></li><li><a href="http://test.sports.tom.com/test_j4614.html" target="_blank">测试一下你是天生的爱情狂吗？</a></li><li><a href="http://test.sports.tom.com/test_j4613.html" target="_blank">快来测测，谁会借钱帮你过难关</a></li><li><a href="http://test.sports.tom.com/test_j4626.html" target="_blank">信不信由你，测你的性感魅力！</a></li>								</ul>
<!-- 大考场2 -->

			</div>
		</div>        

                <div class="view">
			<h3><span><a href="http://sports.tom.com/sports/tyrj.html" target="_blank"><img src="http://sports.tom.com/uldf/2008/0316/wangfang/images/more.gif" alt="more" /></a></span></h3>
<div class="viewcont">
				
<!-- 多看点 -->
<ul class="viewlist">
<li><em>·<a href="http://post.sports.tom.com/gallery_CE000EE62026.html" target="_blank">富家女放弃追求柳海龙比武招亲</a></em></li><li><em>·<a href="http://post.sports.tom.com/CE000EE62025.html" target="_blank">“悬崖”跳水赛观众挤爆广场</a></em></li><li><em>·<a href="http://post.sports.tom.com/CE000EE62023.html" target="_blank">火箭九大引援对象：基德最该抢</a></em></li><li>·<a href="http://post.sports.tom.com/CE000EE62022.html" target="_blank">英超宝贝变身A1赛车女郎</a></li><li>·<a href="http://post.sports.tom.com/CE000EE62018.html" target="_blank">日本艺术体操新星写真</a></li><li>·<a href="http://post.sports.tom.com/CE000EE62017.html" target="_blank">帕克与娇妻走秀伊娃短裤秀美腿</a></li><li>·<a href="http://post.sports.tom.com/CE000EE62016.html" target="_blank">健身教练体验肥胖生活自毁身材</a></li><li>·<a href="http://post.sports.tom.com/CE000EE62015.html" target="_blank">火箭化身《街霸》姚明邪恶魔人</a></li></ul> 
<!-- 多看点 -->
			</div>
		</div>

	</div>


</div>
<!--}end container-->
<div style="text-align:center">
<script src="http://js.pub.tom.com/8/sport-tl950.js"> </script>
</div>
<!--{start basketball column-->
<div class="column basketball">
	<div class="title">
<!-- 栏目导航-篮球 -->
<span><a href="http://nba.sports.tom.com/yaoming/index.html" target="_blank">姚明</a></span>
		<span><a href="http://nba.sports.tom.com/yijianlian/index.html" target="_blank">易建联</a></span>
		<span><a href="http://live.sports.tom.com/" target="_blank">比分直播</a></span>
		<span><a href="http://live.sports.tom.com/stats.html" target="_blank">数据库</a></span>
		<span><a href="http://nba.sports.tom.com/lakers/index.html" target="_blank">湖人</a></span>
		<span><a href="http://nba.sports.tom.com/celtics/index.html" target="_blank">凯尔特人</a></span>
		<span><a href="http://nba.sports.tom.com/nba/cehua/index.html" target="_blank">特别策划</a></span>
		<a href="http://nba.sports.tom.com/" target="_blank"><img src="http://sports.tom.com/uldf/2008/0316/wangfang/images/more.gif" alt="more" border="0" /></a>
<!-- 栏目导航-篮球 -->
	</div>
	<div class="columncont">
		<div class="left">
			<div class="ltop">
				<div class="picnews">
<!-- 头条图片-篮球 -->
<ul>
<li><a href="http://nba.sports.tom.com/2009-05-22/0KOF/83240328.html" target="_blank"><img src="http://sports.tom.com/uldf/2009/0522/yujing/174x123.jpg" alt="
20大季后赛高中生PK"/></a> <a href="http://nba.sports.tom.com/2009-05-22/0KOF/83240328.html" target="_blank">
20大季后赛高中生PK</a></li>
</ul>
<!-- 头条图片-篮球 --> 
				</div>
				<div class="topnews">
<!-- 头条-篮球1 -->
<dl>
<dt><em> <a href="http://nba.sports.tom.com/2009-05-21/0KOF/83471183.html" target="_blank">乔丹领30大季后杀人王</a></em></dt>

<dd><a href="http://nba.sports.tom.com/2009-05-19/0KOF/83854284.html" target="_blank">15大火箭夏季攻略交易麦迪</a> <a href="http://nba.sports.tom.com/2009-05-20/0KOF/83780611.html" target="_blank">20大给姚明传球人</a></dd>
<dd><a href="http://nba.sports.tom.com/2009-05-16/0KOF/83969292.html" target="_blank">大叔领20大老兵不死</a> <a href="http://nba.sports.tom.com/2009-05-15/0KOF/84524196.html" target="_blank"> 17大鸡肋领袖：姚麦上榜</a></dd>

</dl>
<!-- 头条-篮球1 --> 
<!-- 头条-篮球2 -->
<dl>
						<dt><a href="http://nba.sports.tom.com/2009-05-22/0424/24593807.html" target="_blank">曾经的麦迪不复存在</a></dt>  
						<dd>
<a href="http://nba.sports.tom.com/2009-05-22/0424/04923857.html" target="_blank">纳什是姚明生涯最佳搭档 三特点助巨人夺冠</a></dd>
                  
                        <dd>
<a href="http://nba.sports.tom.com/2009-05-22/0424/02023253.html" target="_blank">火箭恐难满足沃弗尔胃口 扣篮王成休城首选</a></dd>
						
						
					</dl>
<!-- 头条-篮球2 --> 

				</div>
				<div class="clear"></div>
			</div>
			<div class="lbottom">
<!-- 新闻列表-篮球 -->
<ul>
					<li> · <A href=' http://nba.sports.tom.com/2009-05-22/0424/26058762.html' target=_blank>灰熊欲出售二号签换金钱 火箭有望求得西班牙金童</A> <span>05/22 15:14</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-22/0424/24593807.html' target=_blank>媒体列数据与麦迪秋后算账 曾经的一号已不复存在</A> <span>05/22 14:49</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-22/0O8N/06244043.html' target=_blank>詹姆斯惊讶刘易斯表现 特科格鲁：对全队充满信心</A> <span>05/22 09:44</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-22/0O8N/03680384.html' target=_blank>威廉姆斯主动承担失利责任 詹姆斯拒绝主场再输球</A> <span>05/22 09:01</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-22/0O8N/02376667.html' target=_blank>魔术三巨头围剿骑士 土耳其高射炮蜕变让皇帝头疼</A> <span>05/22 08:39</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-21/0O8N/26906814.html' target=_blank>特科格鲁变身魔术组织后卫 土耳其人成第四节杀手</A> <span>05/21 15:28</span><br>
      · <A href='http://post.sports.tom.com/s/CD000AB01009.html' target=_blank>斯特恩：很高兴亚历山大赚大钱 联盟需要更多姚明</A> <span>05/21 15:19</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-21/0O8N/21473508.html' target=_blank>霍华德：球队赢得伟大比赛 布朗称骑士输球非坏事</A> <span>05/21 13:57</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-21/0O8N/15550116.html' target=_blank>骑士替补低迷遭魔术压制 吉布森需尽快找回攻击力</A> <span>05/21 12:19</span><br>
      · <A href=' http://nba.sports.tom.com/2009-05-21/0O8N/15482171.html' target=_blank>魔兽身边藏有两大真正杀手 生死时刻他们一剑封喉</A> <span>05/21 12:18</span><br>
       </li></ul>
<!-- 新闻列表-篮球 -->
 			</div>
		</div>
		<div class="middle">
			<div class="survey">
<!-- 小栏目-篮球1 -->
<h3>调查</h3>
<form name="form133640" method="post" target="_blank" action="http://vote.sports.tom.com/answer.jhtm"><input name="voteId" type="hidden" value="133640" />
<input name="listAnswer[0].questionId" type="hidden" value="138827" />谁是姚明未来的最佳搭档？   <br/>
<input type="radio" value="712838" name="listAnswer[0].checkitemId"> 科比
<br/>
<input type="radio" value="712839" name="listAnswer[0].checkitemId"> 詹姆斯
<br/>
<input type="radio" value="712840" name="listAnswer[0].checkitemId"> 韦德
<br/>
<input type="radio" value="712841" name="listAnswer[0].checkitemId"> 保罗
<br/>
<input type="radio" value="712842" name="listAnswer[0].checkitemId"> 德隆 <input type="radio" value="712843" name="listAnswer[0].checkitemId"> 麦迪<br/><input type="radio" value="712844" name="listAnswer[0].checkitemId">纳什 <input type="radio" value="712845" name="listAnswer[0].checkitemId"> 基德<br/>

                                                                                                                                                                                                                                                                                                                                                                                                                             <script type="text/javascript" src="http://rss.tom.com/uldf/2008/1005/yudan/formcheck.js"></script> 
<button name="submit" style="padding:0;margin:10px 10px 0 0;width:75px;height:23px;line-height:23px;font-size:12px;border:1px solid #a3a3a3;background:url(http://rss.tom.com/uldf/2007/0907/minbo/button.gif) repeat-x;" type="submit">提交</button>  
<button style="padding:0;margin:10px 0 0 0;width:75px;height:23px;line-height:23px;font-size:12px;border:1px solid #a3a3a3;background:url(http://rss.tom.com/uldf/2007/0907/minbo/button.gif) repeat-x;" type="button"  onclick="javascript:window.open('http://vote.sports.tom.com/r-133640.html');">查看</button></form>
<script language="JavaScript" type="text/javascript">document.form133640.elements["submit"].onclick=function(){
var checkedCount=0;	
                                                                                                                                                                                                                                                                                                                                                      for(var i=0;i<document.form133640.elements.length;i++){
if(document.form133640.elements[i].checked)checkedCount++;}
if(checkedCount==0){alert("请做出选择！");return false;}return true;}</script>
<!-- 小栏目-篮球1 -->
			</div>
			<div class="pk">
<!-- 小栏目-篮球2 -->
<h3>大嘴榜单</h3>
				<ul class="newsnav">
					<li id="news1" onclick="Tab('news',1,4)" class="current">漫画</li>
					<li id="news2" onclick="Tab('news',2,4)">鞋柜</li>					
				</ul>
				<ul class="newscont">
					<div id="news_cont1">
						<li><a href="/2009-01-24/0424/25701286.html" target="_blank">三巨头齐受伤 阿帅挠头...</a></li><li><a href="/2009-01-22/0425/23668204.html" target="_blank">大姚拍死季后赛死敌...</a></li><li><a href="/2009-01-14/0424/21846889.html" target="_blank">瘸腿火箭爆发最强音...</a></li><li><a href="/2009-01-08/0KSO/26465947.html" target="_blank">阿联连续20+找回自信...</a></li><li><a href="/2009-01-03/0424/20376714.html" target="_blank">麦迪变身无脊椎动物...</a></li>					</div>
					<div id="news_cont2" style="display:none;">
						<li><a href="/2009-05-05/0BLC/17855812.html" target="_blank">今天要说的这双鞋叫做NIKE Foamp...</a></li><li><a href="/2009-04-06/0BLC/04325086.html" target="_blank">2008年是AIR JORDAN系列的第23个...</a></li><li><a href="/2009-04-03/0BLC/85721574.html" target="_blank">2007年，一部叫做《士兵突击》的...</a></li><li><a href="/2009-04-01/0BLC/25462341.html" target="_blank">在阿玛雷-斯塔德迈尔出名之前，...</a></li><li><a href="/2009-01-09/08JI/25997158.html" target="_blank">自从AIR JORDAN XX3发布以来，便...</a></li>					</div>
				</ul>
<!-- 小栏目-篮球2 -->
			</div>
		</div>
		<div class="right">
			<div class="nbalist">
<!-- 数据列表-篮球1 -->
<div class="nbalist">
				<h3>赛程赛果</h3>
				<div id="nba_cont1">
					<iframe src="http://live.sports.tom.com/scripts/day.html" width="210" height="195" frameborder="no" border="0" MARGINWIDTH="0" MARGINHEIGHT="0" SCROLLING="no"></iframe>
				</div>
<!-- 数据列表-篮球1 -->
			</div>
			<div class="datalist">
<!-- 数据列表-篮球2 -->
<div class="nbalist">
				<h3>特约专家<span></span></h3>
				<div id="nba_cont1">
					<p>                ·<a href="http://nba.sports.tom.com/2009-05-22/0L16/21219949.html" target="_blank">张卫平：老鱼被爆 第三场赢家晋级</a><br>
                ·<a href="http://nba.sports.tom.com/2009-05-22/0L16/20538414.html" target="_blank">杨毅：无人防甜瓜 湖人更可能晋级</a><br>
                ·<a href="http://nba.sports.tom.com/2009-05-20/0L16/20254825.html" target="_blank">杨毅：老鱼回报信任 扼住昌西必死</a><br>
                ·<a href="http://nba.sports.tom.com/2009-05-20/0L16/19631576.html" target="_blank">张卫平：四人无法阻科比 掘金难胜</a><br>
                ·<a href="http://nba.sports.tom.com/2009-