sports.163.com.html

一个java+Mysql写的主题爬虫,可以通过给定初始的url爬取到相关的网页

<li><a href="http://auto.163.com" class="tip">汽车</a> 　<a href="http://product.auto.163.com/">车库</a>　<a href="http://nie.163.com/">游戏</a></li>
<li class="s5"><a href="http://mobile.163.com/" class="tip">手机</a> 　<a href="http://digi.163.com/dc/">相机</a>　<a href="http://www.qutu.com/getadclick.jsp?id=200000&url=http%3A%2F%2F163.qutu.com%2F">旅游</a></li>
</ul>
</div>
<div class="menu s2 stroke">
<ul>
<li><a href="http://house.163.com/" class="tip">房产</a> 　<a href="http://home.163.com/">家居</a>　<a href="http://163.39.net/">健康</a></li>
<li class="s5"><a href="http://v.163.com/" class="tip">视频</a> 　<a href="http://baby.163.com/">亲子</a>　<a href="http://sports.163.com/lottery/">彩票</a></li>
</ul>
</div>
<div class="menu s4">
<ul>
<li><a href="http://bbs.163.com/" class="tip">论坛</a> 　<a href="http://guba.money.163.com/">股吧</a>　<a href="http://news.163.com/rank/">排行</a></li>
<li class="s5"><a href="http://blog.163.com/?fromChannel" class="tip">博客</a> 　<a href="http://tie.163.com/">跟贴</a>　<a href="http://pp.blog.163.com/">拍拍</a></li>
</ul>
</div>
</div>
</div>
<div class="ggarea clearfix">
<span class="blank9"></span>
<ul class="ggtext">
<li><a href="http://sports.163.com/special/00052FJJ/rocketteam.html">关注火箭交易</a></li>
<li><a href="http://sports.163.com/nba/">NBA季后赛火爆开赛</a></li>
<li><a href="http://sports.163.com/special/00053BCE/2009sudirman.html">有奖竞猜 赢苏杯门票</a></li>
<li><a href="http://sports.163.com/tv/">体育电视直播表</a></li>
<li><a href="http://go.sports.163.com/greatkill/">上传图片 赢羽球装备</a></li>
<li><a href="http://sports.163.com/special/000539PM/dapengche2009.html">玩大篷车 赢李宁大奖</a></li>
<li><a href="http://2010.163.com/special/00863BM8/0424zhiyuanzhe.html">亚运志愿者招募进行中</a></li>
</ul>
    <span class="blank9"></span>
    <ul class="ggimg">
<SCRIPT LANGUAGE="JavaScript">
<!--
var rdm_ifr=Math.random();
//document.write(rdm_ifr);
if (rdm_ifr>0.5){
document.write('<iframe src="http://img1.126.net/channel1/html/lining/0518/hp10.html" width="935" height="80" frameborder="no" border="0" marginwidth="0" marginheight="0" scrolling="no"></iframe>');
}
else
{
document.write('<iframe src="http://img1.126.net/channel1/html/lining/hp11.html" width="935" height="80" frameborder="no" border="0" marginwidth="0" marginheight="0" scrolling="no"></iframe>');
}
//-->
</SCRIPT>
    </ul>
    <span class="blank6"></span>
	<ul class="ggtext">
<li><a href="http://sports.163.com/special/00052G97/marry.html">体坛最美丽新娘</a></li>
<li><a href="http://bbs.sports.163.com/bbs/basketball/129709667.html">NBA季后赛征文</a></li>
<li><a href="http://sports.163.com/china/">新版中国足球首页上线</a></li>
<li><a href="http://bbs.sports.163.com/bbs/basketball/130652662.html">NBA10大高薪低能</a></li>
<li><a href="http://bbs.sports.163.com/bbs/photoshow/129628347.html">体坛14大浪漫求婚</a></li>
<li><a href="http://bbs.sports.163.com/bbs/shalong/130724865.html">英超史上50大外援</a></li>
<!-- li><a href="http://sports.163.com/special/00052G99/lindan.html">林丹的团长故事</a></li -->
<li><a href="http://hr.163.com/special/00813A60/recruitment0407.html?455555#pc2">网易招聘WEB工程师</a></li>
    </ul>
    <span class="blank9"></span>
</div>
<a name="top" id="top"></a>
<span class="blank9"></span>
<div class="channel">
<span class="liningLogo"><a href="http://sports.163.com/"><img src="http://img1.cache.netease.com/sports/img/index09/lininglogo.gif" width="151" height="49" alt="" /></a></span>
<h1><a href="http://sports.163.com/" target="_self"><img src="http://img1.cache.netease.com/sports/img/index09/sportslogo.gif" width="128" height="49" alt="网易体育" /><br />网易体育</a></h1>
<div class="focus">
<ul>
<li class="s1">
<h2><a href="http://cbachina.163.com/tcb/">篮球</a></h2>
<h3><a href="http://sports.163.com/nba/">NBA</a> <a href="http://sports.163.com/special/00052FJJ/rocketteam.html">火箭</a><br /><a href="http://cbachina.163.com/">CBA</a> <a href="http://cbachina.163.com/tcb/">男篮</a></h3>
</li>
<li class="s2">
<h2><a href="http://sports.163.com/world/">国际</a></h2>
<h3><a href="http://sports.163.com/yc/">英超</a> <a href="http://sports.163.com/xj/">西甲</a> <a href="http://sports.163.com/gjb/">欧冠</a><br /><a href="http://sports.163.com/yj/">意甲</a> <a href="http://sports.163.com/dj/">德甲</a> <a href="http://sports.163.com/lottery/">彩票</a></h3>
</li>
<li class="s3">
<h2><a href="http://sports.163.com/china/">国内</a></h2>
<h3><a href="http://sports.163.com/gjd/">国足</a> <a href="http://sports.163.com/oversea/">海外</a> <a href="http://sports.163.com/nz/">女足</a><br /><a href="http://sports.163.com/zc/">中超</a> <a href="http://sports.163.com/special/000537T5/afc2009.html">亚冠</a> <a href="http://sports.163.com/zj/">中甲</a></h3>
</li>
<li class="s4">
<h2><a href="http://sports.163.com/allsports/">综合</a></h2>
<h3><a href="http://sports.163.com/tennis/">网　球</a> <a href="http://sports.163.com/f1/">F1</a>　 <a href="http://sports.163.com/special/00053BD8/2009ttworld50.html">世乒赛</a><br /><a href="http://sports.163.com/ding/">斯诺克</a> <a href="http://sports.163.com/lx/">刘翔</a> <a href="http://sports.163.com/special/00053BCE/2009sudirman.html">苏迪曼</a></h3>
</li>
</ul>
</div>
</div>
<div class="subChannel">
<div class="menu">
<ul>
<li class="t1"><a href="http://sports.163.com/special/s/0005rt/sportsgd.html">滚动</a></li>
<li><a href="http://bbs.sports.163.com/">论坛</a></li>
<li><a href="http://blog.163.com/pub/channel/sports.html">博客</a></li>
<li><a href="http://v.sports.163.com/"><span class="cYellow">视频</span></a></li>
<li><a href="http://sports.163.com/photo/">图片</a></li>
<li><a href="http://fantasy.sports.163.com/">梦幻足球</a></li>
<li><a href="http://sports.163.com/goal/">欧洲足球</a></li>
<li><a href="http://bbs.sports.163.com/list/ymq.html">羽球社区</a></li>
<li><a href="http://cbachina.163.com/"><span class="cYellow">CBA官网</span></a></li>
<li><a href="http://winnerway.163.com/">广东男篮</a></li>
<li><a href="http://gpcfootball.163.com/">广药足球</a></li>
<li><a href="http://sports.163.com/gdtv/">广东体育</a></li>
<li><a href="http://www.shggp.com/">黄金大奖赛</a></li>
<li><a href="http://2010.163.com/jlb/">亚运啦啦队</a></li>
<li><a href="http://2010.163.com/">亚运频道</a></li>
<li class="t2"><a href="http://help.3g.163.com/live/">手机版</a></li>
</ul>
</div>
<!-- 导航李宁广告 -->
<div class="lnPic">
<ul>
<li><a href="http://sports.163.com/special/00051QF5/pingpong.html"><img src="http://img1.cache.netease.com/sports/img/index09/tbg28.gif" width="94" height="26" alt="中国金牌队" /></a></li>
<li><a href="http://www.li-ning.com"><img src="http://img1.cache.netease.com/sports/img/index09/tbg29.gif" width="92" height="26" alt="李宁官网" /></a></li>
<li><a href="http://www.e-lining.com/"><img src="http://img1.cache.netease.com/sports/img/index09/tbg30.gif" width="113" height="26" alt="李宁电子商城" /></a></li>
</ul>
</div>
<div class="lnText"><span class="c1"><a href="http://pro.163.com/event.ng/Type=click&FlightID=138537&AdID=140357&TargetID=509&Values=31,43,51,60,72,83,91,100,110,150,312,317,330,332,358,457,585,702,733,734,774,788,942,943,948,949,950,1003,1125,1129&Redirect=http://sports.163.com/lining/"><img src="http://img1.cache.netease.com/sports/img/index09/tbg05.gif" width="49" height="17" alt="" /></a></span><h3><a href="http://sports.163.com/dapengche2009">享练主义 09李宁大篷车</a></h3></div>
</div>
<span class="blank9"></span>
<div class="pArea clearfix">
<div class="pAreaL">
<div class="area clearfix">
<div class="col1">
<div class="focusText">
<h3><span class="c1">NBA</span>
<a href="http://sports.163.com/special/00052VPU/hrjj0809.html">掘金逆转湖人战成1-1</a> <a href="http://sports.163.com/09/0522/12/59TS1BPI00051CA1.html">科比32分却送致命失误</a> <a href="http://comment.sports.163.com/sports_nba_bbs/59TRK17100051CA1.html">评</a> </h3>
<ul>
<li><span class="cBlack">[比赛]</span>
<a href="http://sports.163.com/09/0522/12/59TS2EVV00051CA1.html">昌西26分戏耍科比堪称MVP</a> | 
<a href="http://sports.163.com/09/0522/12/59TSE7ID00051CA1.html">安东尼砍34分引领逆转</a> | 
<a href="http://sports.163.com/09/0522/10/59TMQJ2V00052UA4.html">阿泰现场观战(图)</a></li>
<li><span class="cBlack">[关注]</span>
<a href="http://sports.163.com/special/00052VV8/qsms0809.html">明8点半骑士再战魔术</a> | 
<a href="http://sports.163.com/09/0522/14/59U46CQK00051CA1.html"><span class="cDRed">华人老板收购骑士获通过</span></a> | 
<a href="http://sports.163.com/09/0522/05/59T4T9BJ00051CA1.html">皇帝压倒科比获最佳</a></li>
<li><span class="cBlack">[焦点]</span>
<a href="http://sports.163.com/09/0522/06/59T9LGJK00051CA1.html">魔兽已超姚明媲美大梦</a> | 
<a href="http://sports.163.com/09/0522/01/59SMLRRJ00051CA1.html">洛佩兹:姚明鲨鱼最难挡</a> | 
<a href="http://sports.163.com/09/0522/14/59U455LN00051CA1.html">霍里丢七枚冠军戒指</a></li>
</ul>
<span class="blank9"></span>
<h3><span class="c1">火箭</span> <a href="http://sports.163.com/nba/">休城媒体:火箭将签天尊</a> <a href="http://sports.163.com/09/0522/09/59TJ89JH00051CA1.html">小牛追阿泰基德或来火箭</a></h3>
<ul>
<li><span class="cBlack">[火箭]</span>
<a href="http://sports.163.com/09/0522/10/59TNN0E900051CA1.html">德大内线休城训练获赞</a> | 
<a href="http://sports.163.com/09/0521/11/59R9A06A00051CA1.html">火箭看上62分怪兽中锋</a> 
| <a href="http://sports.163.com/09/0522/09/59TIO2OT00051CA1.html">华人老板曾想买火箭</a></li>
<li><span class="cBlack">[火箭]</span>
<a href="http://sports.163.com/09/0522/10/59TOASCT00051CA1.html">狼队高层巨变危及火箭</a> | 
<a href="http://sports.163.com/09/0522/11/59TOLPCK00051CA1.html">巴克利:火箭不会送走姚明</a> | 
<a href="http://sports.163.com/09/0522/12/59TSNA8K00051CA1.html">火箭续约助教团队</a></li>
</ul>
<span class="blank9"></span>
<h3><span class="c1">亚冠</span>
<a href="http://sports.163.com/special/000537T5/afc2009.html">传鲁能惨败队员涉赌还互殴</a>
<a href="http://sports.163.com/09/0522/05/59T6G1AU00051C89.html">鲁能:不是耻辱是犯罪</a></h3>
<ul>
<li><span class="cBlack">[声音]</span>
<a href="http://sports.163.com/09/0522/05/59T66C1T00051C89.html">球迷呼吁司法调查</a> | 
<a href="http://sports.163.com/09/0522/06/59T84L6700051C89.html">媒体炮轰鲁能不懂羞耻</a> | 
<a href="http://sports.163.com/09/0522/06/59T8GFLL00051C89.html">南勇批:输球不能不了了之</a></li>
<li><span class="cBlack">[鲁能]</span>
<a href="http://sports.163.com/09/0522/09/59THT81U00051C89.html">鲁能球员不敢回国</a> | 
<a href="http://sports.163.com/09/0522/10/59TNMTEV00051C89.html">老总:球员傻了</a> | 
<a href="http://sports.163.com/09/0522/11/59TRT9JC00051C89.html">图巴:鲁能球员太大牌</a> <a href="http://sports.163.com/09/0522/10