www.espnstar.com.cn.html

一个java+Mysql写的主题爬虫,可以通过给定初始的url爬取到相关的网页

<div class="flash"></div>
</div>
<script src="index_file/js/vnet.js"></script>
<div id="menu" class="clear">
<!-- 导航 begin -->
<div class="menu1">
<a href="/default.htm" class="a">首页</a>
<a href="/new/feature/ucl/" target=_blank>欧冠</a>
<a href="http://video.espnstar.com.cn/" target=_blank>宽频中心</a>
<a href="/new/international/"  target=_blank>国际足球</a>
<a href="/new/basketball/" target=_blank>NBA</a>
<a href="/new/chinafootball/" target=_blank>中国足球</a>
<a href="/new/tennis/" target=_blank>网球</a>
<a href="/new/f1/" target=_blank style="margin-left:2px;">F1</a>
<a href="/new/golf/" target=_blank>高尔夫</a>
<a href="/new/collgymnastic/" target=_blank>综合</a>
<a href="/new/xgame/" target=_blank>极限</a>

<a href="http://photo.espnstar.com.cn/" target=_blank>图库</a>

<a href="/new/lottery/" target="_blank">足彩</a>
<a href="http://bbs.espnstar.com.cn/" target="_blank">论坛</a>
</div>
<div class="menu2">
<a href="http://acmilan.espnstar.com.cn/" target="_blank" class="a">AC米兰官网</a>
<a href="/new/essjournal/newindex/" target="_blank">单屏期刊</a>
<a href="/new/SpecialTopic/" target="_blank">眼界</a>
<a href="http://blog.espnstar.com.cn/" target="_blank">博客</a>
<a href="/new/match/" target="_blank">数据</a>
<a href="/new/tv/emcee/" target="_blank">名嘴主持</a>
<a href="http://photo.espnstar.com.cn/pub/Phototype/Parent/P1762.htm" target="_blank">大视角</a>
<a href="/new/tv/program/" target="_blank">电视预告</a>
<a href="/pub/SpecialTopic/659.htm" target="_blank">世锦赛</a>
<a href="http://live.espnstar.com.cn/" target="_blank">文字直播</a>
<a href="http://nba.espnstar.com.cn/score.asp" target="_blank">比分直播</a>
<a href="http://www.zuqiuwenming.com/" target="_blank">足球文明</a>
<a href="http://juventus.espnstar.com.cn/" class="at" target="_blank">尤文图斯官网</a> 
</div>
<!-- 导航 end -->
</div>
<div id="main" class="clear">
<div id="con457" class="left">
<!--头条 begin -->

<div id="topnew">
<div class="pic">
<a href="/pub/basketball/2009/0522/123980.htm" target="_blank"><img src="/new/index_file/Images/HometitleImg/Home2009522123613841.jpg" border="0" /></a>
<h1><a href="/pub/basketball/2009/0522/123980.htm" target="_blank">罪人科比</a> </h1>
</div>
<div class="text"><img src="/new/index_file/images/toutiaozhongshu.jpg"/> NBA西部决赛第二场，湖人在主场以<a href="/pub/basketball/2009/0522/123985.htm" title="统计：掘金106-103湖人 甜瓜34分压科比" target=_blank>103-106</a>惜败于掘金，总比分被<a href="/pub/basketball/2009/0522/123992.htm" title="美媒：甜瓜压科比 掘金胜湖人雪24年耻辱" target=_blank>扳为1-1</a>。湖人第二节曾领先达两位数，但半场被掘金追到只差1分，比赛势头在悄悄发生变化。下半场两队互不相让，最后时刻科比的一次<a href="/pub/basketball/2009/0522/123983.htm" title="得分多者赢比赛？ 科比失误间接葬送胜利" target=_blank>致命失误</a>断送了湖人，掘金在<a href="/pub/basketball/2009/0522/123986.htm" title="连续5场30+追平科比 宿命之战安东尼胜出" target=_blank>安东尼的带领下</a>夺回主场优势。第三场将于24日移师丹佛进行。</div>
</div>

<!--头条 end -->
<div class="other"><script type="text/javascript">
AC_FL_RunContent( 'align','center','codebase','http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=7,0,19,0','width','448','height','175','title','要闻风暴','src','index_file/flash/timer?myxmll=\'index_file/flash/timer.xml\'','quality','high','pluginspage','http://www.macromedia.com/go/getflashplayer','wmode','transparent','movie','index_file/flash/timer?myxmll=\'index_file/flash/timer.xml\'' ); //end AC code
</script><noscript><object align="center" classid="clsid:D27CDB6E-AE6D-11cf-96B8-444553540000" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=7,0,19,0" width="448" height="175" title="要闻风暴">
<param name="movie" value="index_file/flash/timer.swf?myxmll='index_file/flash/timer.xml'" />
<param name="quality" value="high" />
<PARAM NAME="wmode" value="transparent">
<embed src="index_file/flash/timer.swf?myxmll='index_file/flash/timer.xml'" width="448" height="175" quality="high" pluginspage="http://www.macromedia.com/go/getflashplayer" type="application/x-shockwave-flash" wmode="transparent"></embed>
</object>
</noscript></div>
<!-- 国际足球 begin -->
<div class="title"><b><a href="/new/international/" target="_blank">国际足球</a></b>
<a href='/new/international/yc.html' target='blank'>英超</a>|<a href='/new/international/serie-a.html' target='blank'>意甲</a>|<a href='/new/international/xj.html' target='blank'>西甲</a>|<a href='/new/international/lfp.html' target='blank'>法甲</a>|<a href='/new/international/df.html' target='blank'>德甲</a>
<select name="gjlist" onChange="window.open(this.options[this.selectedIndex].value,'','')">
	<option value="/new/feature/ucl/index.html" selected>欧冠豪门</option>
	<option value="/new/feature/ucl/ClubInfo_93.html">切尔西</option>
	<option value="/new/feature/ucl/ClubInfo_94.html">巴塞罗那</option>
	<option value="/new/feature/ucl/ClubInfo_92.html">国际米兰</option>
	<option value="/new/feature/ucl/ClubInfo_71.html">利物浦</option>
	<option value="/new/feature/ucl/ClubInfo_76.html">埃因霍温</option>
	<option value="/new/feature/ucl/ClubInfo_148.html">拜仁</option>
	<option value="/new/feature/ucl/ClubInfo_100.html">罗马</option>
	<option value="/new/feature/ucl/ClubInfo_103.html">里昂</option>
	<option value="/new/feature/ucl/ClubInfo_102.html">皇马</option>
	<option value="/new/feature/ucl/ClubInfo_107.html">曼联</option>
	<option value="/new/feature/ucl/ClubInfo_109.html">凯尔特人</option>
	<option value="/new/feature/ucl/ClubInfo_50.html">阿森纳</option>
	<option value="/new/feature/ucl/ClubInfo_78.html">波尔图</option>
	<option value="/new/feature/ucl/ClubInfo_145.html">尤文</option>
</select>
</div>
<div class="myteam"><iframe name="newsiframe" src="/new/CustomMyTeam/publish/international.html" width="450" height="200" frameborder="0" scrolling="no"></iframe></div>
<div class="index_rolltext">
    <img src="/new/images/index_rolltext_05.png" class="roll_log" />
    <div class="roll_con"><img src="/new/images/index_rolltext_08.png" align="left" /><img src="/new/images/index_rolltext_11.png" align="right" />
<script type="text/javascript" src="/new/international/js/espn_default_rolltext.js"></script>
	</div>
</div>
<ul class="list" id=gzzq>
<li><span class="time"> [ 15:15 ] </span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0522/124007.htm" target="_blank">穆里尼奥99.9%留国米 执教蓝黑快乐满足</a></li>
<li><span class="time"> [ 15:00 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0522/124004.htm" target="_blank">卡卡点评三大绯闻主帅 渴望安切洛蒂留守</a></li>
<li><span class="time"> [ 13:28 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0522/123988.htm" target="_blank">高卢边防兵越境无解 比利牛斯成致命枷锁</a></li>
<li><span class="time"> [ 11:12 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0522/123973.htm" target="_blank">上任3天尤文折两将 皮队堪忧铁卫提前度假</a></li>
<li><span class="time"> [ 10:53 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0522/123970.htm" target="_blank">兰帕德获蓝军赛季最佳 球队铁卫意外荣誉</a></li>
<li><span class="time"> [ 10:47 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0522/123969.htm" target="_blank"><span style='color:red;'>尤文官网“29冠”论 大卡策反白宫黑铁塔</span></a></li>
<li><span class="time"> [ 09:31 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0522/123954.htm" target="_blank">「组图」梅西出席媒体日 巴萨磨刀向欧冠</a></li>
<li><span class="time"> [ 08:21 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/df.html" target="_blank"><img src="/new/index_file/images/004_02.gif" alt="德意志" /></a></span><a href="/pub/international/2009/0522/123944.htm" target="_blank">星月之夜欧洲之巅 悲欢两重天悬疑一只猫</a></li>
<li><span class="time"> [ 04:50 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0522/123943.htm" target="_blank">弗格森受迫将遣主力 弗莱彻保证绝不放水</a></li>
<li><span class="time"> [ 03:12 ] </span><span class="sort"><a href="/new/international/hy.html" target="_blank"><img src="/new/index_file/images/005.gif" alt="美非欧" /></a></span><a href="/pub/international/2009/0522/123942.htm" target="_blank">新一届巴西大小罗无名 米兰双雄各入两人</a></li>
<li><span class="time"> [ 02:20 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0522/123941.htm" target="_blank">小白亨利有望战曼联 巴萨边卫召唤里贝里</a></li>
<li><span class="time"> [ 23:08 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0521/123940.htm" target="_blank">穆帅向莫拉蒂表忠心 国米斥皇马勾引行径</a></li>
<li><span class="time"> [ 22:30 ] </span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0521/123938.htm" target="_blank">旧将支持温格赴皇马 两大股东全力留教授</a></li>
<li><span class="time"> [ 21:48 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0521/123937.htm" target="_blank">国米妖星不如日本人?雷人发型回帕托挑衅</a></li>
<li><span class="time"> [ 21:02 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0521/123936.htm" target="_blank">拉法邀请巴萨伯乐 对抗曼联转会恐创新高</a></li>
<li><span class="time"> [ 20:54 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0521/123935.htm" target="_blank"><span style='color:blue;'>马竞欲得墨西哥天才门神 仅24岁已是队长</span></a></li>
<li><span class="time"> [ 19:59 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0521/123934.htm" target="_blank">曼城关注西甲高效射手 马竞夏季恐失大将</a></li>
<li><span class="time"> [ 19:35 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0521/123933.htm" target="_blank">银河舰长对手登台 声称中国不卖皇马球衣</a></li>
<li><span class="time"> [ 18:26 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0521/123920.htm" target="_blank">枪手招牌缩水 铁卫不屑来落寞天才将欲走</a></li>
<li><span class="time"> [ 17:37 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/feature/ucl/" target="_blank"><img src="/new/index_file/images/006.gif" alt="冠军杯" /></a></span><a href="/pub/0607UEFA/2009/0521/123914.htm" target="_blank">里奥请战欧冠大对决 红魔最强防线御巴萨</a></li>
<li><span class="time"> [ 17:14 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0521/123910.htm" target="_blank">埃托奥拒绝和伊布交换 离开巴萨难以想象</a></li>
<li><span class="time"> [ 15:26 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/xj.html" target="_blank"><img src="/new/index_file/images/003.gif" alt="西班牙" /></a></span><a href="/pub/international/2009/0521/123896.htm" target="_blank">马卡报再落井下石 卡尔德隆面临三年牢狱</a></li>
<li><span class="time"> [ 15:07 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yj.html" target="_blank"><img src="/new/index_file/images/002.gif" alt="意大利" /></a></span><a href="/pub/international/2009/0521/123890.htm" target="_blank">又一蓝军名帅执教尤文？拉涅利恐去掌蓝鹰</a></li>
<li><span class="time"> [ 14:49 ] </span><span class="pic"><img src='/new/index_file/images/pic1.gif' alt='图片' /></span><span class="sort"><a href="/new/international/yc.html" target="_blank"><img src="/new/index_file/images/001.gif" alt="英吉利" /></a></span><a href="/pub/international/2009/0521/123889.htm" target="_blank">红军再爆重金计划 全力竞购英超年度最佳</a></li>
</ul>

<!-- 国际足球 end -->

<!-- 篮球 begin -->
<div class="title"><b><a href="/new/basketball/" target="_blank">篮球</a></b><a href='http://www.espnstar.com.cn/pub/basketball/2008/0807/82416.htm' target='blank'>火箭常规赛全记录</a>|<a href='http://www.espnstar.com.cn/pub/basketball/2009/0416/119251.htm' target='blank'>季后赛赛程赛果</a>
	<select name="lqlist" onChange="window.open(this.options[this.selectedIndex].value,'','')">
	<option value="/new/basketball/" selected>NBA列强</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=21&k=火箭">火箭</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=18&k=小牛">小牛</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=17&k=马刺">马刺</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=14&k=湖人">湖人</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=6&k=掘金">掘金</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=12&k=太阳">太阳</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=7&k=爵士">爵士</option>
	<option value="/new/basketball/Team.asp?id=11&TeamId=28&k=骑士">骑士</option>