4or3ck.html

一个java+Mysql写的主题爬虫,可以通过给定初始的url爬取到相关的网页

                  ·<a href="http://sports.163.com/09/0522/14/59U324J900051C8V.html">巴萨最令曼联恐惧绝非梅西 中场双核才是真正核 </a> <span style="font-size:12px; color:#666;">(22日14:03)</span><br />
                  ·<a href="http://sports.163.com/09/0522/12/59TSM61O00051C8V.html">巴萨铁腰否认打左后卫战曼联 道出心中最佳人选</a> <span style="font-size:12px; color:#666;">(22日12:12)</span><br />
                  ·<a href="http://sports.163.com/09/0522/10/59TMNIG500051C8V.html">巴萨三年前夺欧冠遇邪事 不速客竟随队庆祝(图)</a> <span style="font-size:12px; color:#666;">(22日10:28)</span><br />
                  ·<a href="http://sports.163.com/09/0522/10/59TM31JU00051CCL.html">埃夫拉:我是世界最佳左后卫 我会冻结梅西证明</a> <span style="font-size:12px; color:#666;">(22日10:16)</span><br />
                  ·<a href="http://sports.163.com/09/0522/09/59TK8CDK00051C8V.html">皇马旧将赞梅西史上第一 挺巴萨夺冠跳蚤拿金球</a> <span style="font-size:12px; color:#666;">(22日09:44)</span><br />
                  ·<a href="http://sports.163.com/09/0522/09/59TIFAOP00051C8V.html">巴萨确认魔翼赛季报销 亨利小白复出可战曼联</a> <span style="font-size:12px; color:#666;">(22日09:13)</span><br />
                  ·<a href="http://sports.163.com/09/0522/08/59THB4NQ00051C8V.html">瓜帅点出欧冠决赛关键 笑称若夺三冠立刻退休</a> <span style="font-size:12px; color:#666;">(22日08:53)</span><br />
                  ·<a href="http://sports.163.com/09/0522/08/59TH9IFS00051C8V.html">梅西赞C罗不可阻挡 称欧冠决赛曼联才是热门</a> <span style="font-size:12px; color:#666;">(22日08:53)</span><br />
                 </td>
      </tr>
</table>
<table width="100%" border="0" cellspacing="0" cellpadding="0">
  <tr>
    <td height="10"></td>
  </tr>
</table>
<script type=text/javascript> 
var istop=1;
var LorR=0;
var speed=30; 
var demo = document.getElementById("demo");
var marquePic1 = document.getElementById("marquePic1");
var marquePic2 = document.getElementById("marquePic2");
marquePic2.innerHTML=marquePic1.innerHTML; 
demo.scrollLeft=marquePic1.scrollWidth/2;
function left(){
	LorR=0;
}
function right(){
	LorR=1;
}
function spd(n){
	speed=n;
	clearInterval(MyMar);
	MyMar=setInterval(Marquee,speed); 
}	
function Marquee(){
if(LorR) MarqueeRight();
else MarqueeLeft();
}
function MarqueeLeft(){
	with (demo) {
        if(scrollLeft>=marquePic1.scrollWidth){ 
            scrollLeft=0
        }else{ 
            scrollLeft++
        }
    }
}
function MarqueeRight(){
	with (demo) {
        if(scrollLeft<=0){ 
            scrollLeft=marquePic1.scrollWidth 
        }else{ 
            scrollLeft--
        }
    }
} 
var MyMar=setInterval(Marquee,speed) 
demo.onmouseover=function() {clearInterval(MyMar)} 
demo.onmouseout=function() {MyMar=setInterval(Marquee,speed)} 
</script>
    </td>
  </tr>
</table>
<style type="text/css">
.pkBox{margin:0 auto; padding:0 10px; clear:both;}
.pkBox .col1{float:left; width:332px;}
.pkBox .col2{float:left; width:10px; font-size:1px; overflow:hidden;}
.pkBox .pkContent{color:#5F5F5F; margin-bottom:10px;}
.pkBox .pkContent h3{font-size:14px; font-weight:bold; text-align:left; margin:10px 0;}
.pkBox .pkContent p{text-align:left; text-indent:24px; margin:0;}
.pkBox .pkContent .but{width:68px; height:19px; background:url(http://img1.cache.netease.com/cnews/template08/images/icon_4.jpg) no-repeat; color:#000; text-align:center; display:inline-block;}
.pkBox .pkTitle{ padding:20px 0 0; clear:both;}
.pkBox .pkTitle .tipBox{ float:left; width:120px;}
.pkBox .pkTitle .tipBox .tip{ margin:0 auto; width:95px; height:60px; }
.pkBox .pkTitle .tipBox .bg1{background:#bc2931;}
.pkBox .pkTitle .tipBox .bg2{background:#1f3a87;}
.pkBox .pkTitle .tipBox .tip h2{font-family: "黑体"; padding:9px 0 0; font-weight:100; font-size: 20px; clear:both; color:#fff;}
.pkBox .pkTitle .tipBox .tip h3{font-family: Arial; font-size:18px; clear:both; color:#fff;}
.pkBox .pkTitle .theText{float:left; width:250px;}
.pkBox .pkTitle .theText h2{font-family: "黑体"; text-align:left; padding:2px 8px 3px 0; line-height:140%; font-weight:100; font-size:20px; clear:both;}
.pkBox .pkSummary{ clear:both; padding:12px 12px 5px 15px; line-height:160%; text-align:left;}
.pkBox .commentContent{clear:both; padding:10px 0;}
.pkBox .commentTitle{height:25px; line-height:25px; border-top:1px dashed #C9C9C9; border-bottom:1px dashed #C9C9C9; clear:both;}
.pkBox .commentTitle h5{ float:left; padding:0 0 0 8px; font-size:12px; font-weight:bold;}
.pkBox .commentTitle span{float:right; margin-right:10px;}
.pkBox .commentTitle .rText{float:right; padding:6px 8px 0 0; font-weight:bold;}
.pkBox .commentContent .theText{ text-align:left; line-height:160%; padding:8px 0 0; color:#414141; table-layout:fixed; overflow:hidden; word-wrap:break-word; word-break:break-all;  height /**/: auto ; }
.pkBox .commentContent .theText table{table-layout:fixed;}
.pkBox .commentContent .theText td{ overflow:hidden; text-overflow:ellipsis;}
.pkBox .commentContent .theReply{ text-align:right; padding:3px 0 5px;}
.pkBox .commentContent a{color:#898989;}
.pkBox .commentContent a:hover{color:#898989;}
.pkBox .pkInput{ clear:both; padding:10px 0 8px; border-top:1px solid #666;}
.pkBox .pkInput .login{ clear:both; padding:0 0 6px 8px; text-align:left;}
.pkBox .pkInput .login .s1{width:55px; border:1px solid #CDCDCD;}
.pkBox .pkInput textarea{border:1px solid #CDCDCD; width:95%; height:60px; margin:0 0 5px; font-size:14px;}
</style>
<table width="960" border="0" cellpadding="0" cellspacing="0" bgcolor="#f3f3f3" style="border-top:3px solid #1D50A3; height:35px;">
 <tr>
					<td colspan="2">
					<table width="100%" border="0" cellspacing="0" cellpadding="0" style="border-left:6px solid #BA2636; background-color:#DCDCDC; height:24px">
      <tr>
        <td width="94%" class="gcGray f14px" style="padding-left:10px;">
		<img src="http://img2.cache.netease.com/sports/2009/2/16/2009021611121456786.gif" width="191" height="38" alt="有话说" /></td>
        <td width="6%" class="gcGray">　</td>
      </tr>
</table>
    <table border="0" width="960" cellspacing="0" cellpadding="0" bgcolor="#FFFFFF">
		<tr>
			<td valign="top">
<script type="text/javascript" language="javascript">
//<![CDATA[
var postNumber1 = "59P5ONN700051QVF";  //正方文章ID
var postNumber2 = "59P5PDOE00051QVF";  //反方文章ID
var theboard ="sports_bbs"; //版面ID
var board = "sports_bbs";
 //]]>
</script>
<style type="text/css">
<!--
:link.replyx{color:#1f3a87; text-decoration:underline;}
:hover.replyx{color:#bc2931;}
:visited.replyx{color:#cccccc;}
.style22 {
	color: #000000;
	font-size: 20px;
	font-family: 黑体;
}
.style24 {
	font-size: 14px;
	font-family: 黑体;
}
.style25 {
	font-size: 14px;
	font-family: 黑体;
	text-align: right;
}
-->
</style>
<script language='javascript' src='http://news3.163.com/js/basic.js'></script>
<script type="text/javascript">
//<![CDATA[
var digitem=new Object();
function VoteDig(domain,voteid,itemid,id){
  if (id=="1"){
  document.getElementById("selectpost1").checked = true;
  getElement('button_'+itemid).innerHTML="<img src=\"http://cimg2.163.com/auto/img07/voted.gif\"/><br><br><a class=\"replyx\" href=\"javascript:replyFun('v1')\"  target=\"_self\">发表正方观点</a>";
  }else{
  document.getElementById("selectpost2").checked = true;
  getElement('button_'+itemid).innerHTML="<img src=\"http://cimg2.163.com/auto/img07/voted.gif\"/><br><br><a class=\"replyx\" href=\"javascript:replyFun('v2')\"  target=\"_self\">发表反方观点</a>";
  }
  getElement('item_'+itemid).innerHTML++;
  var url = "http://"+domain+"/vote/"+voteid+"/"+itemid+"/"; 
  var itemnum = getElement('item_' +itemid);
  if(digitem[itemid]==null) {
  var xhttp=makeRequest();
  xhttp.onreadystatechange=function(){
    if(xhttp.readyState == 4 && (xhttp.status==200 || window.location.href.indexOf("http")==-1))
    {					
    }
  }
  xhttp.open("GET",url,true);
  xhttp.send(null);
  }
}
 //]]>
</script>
<table width="920" border="0" cellspacing="0" cellpadding="0" style="border:1px solid #ccc;">
  <tr>
      <td colspan="3"><table width="960" height="30" border="0" cellspacing="0" cellpadding="0" style="border-bottom:1px solid #ccc;">
        <tr>
          <td class="tCenter"><img src="http://img1.cache.netease.com/cnews/template08/images/pk.gif" alt="pk" width="61" height="14" /></td>
        </tr>
      </table></td>
  </tr>
  <tr>
      <td width="460">  <a href="http://sports.163.com/09/0518/23/59KPPVDR00051C9E.html" class="gcBlue f14px fB">　曼联三夺欧冠回顾：决赛从未失手 99年神奇逆转</a><br />
  　曼联历史上曾3次闯入欧冠决赛，并3次赢得了最终的胜利……<a href="http://sports.163.com/09/0518/23/59KPPVDR00051C9E.html" class="gcRed">[详细]</a>
</td>
      <td width="25">  </td>
      <td width="460">  <a href="http://sports.163.com/09/0518/23/59KPNSIU00051C9E.html" class="gcBlue f14px fB">　巴萨两夺欧冠回顾：决赛胜率仅四成 两代梦之队</a><br />
  　巴萨曾5次闯入欧冠决赛，但只在1992年和2006年两次赢得胜利……<a href="http://sports.163.com/09/0518/23/59KPNSIU00051C9E.html" class="gcRed">[详细]</a>
</td>
  </tr>
</table>
<span class="blank9"></span>
<div class="pkBody">
  <div class="col1">
    <div class="title">
      <h3>正方：曼联胜</h3>
      <h4>评论共93条</h4>
      <h6><a href="http://comment.sports.163.com/sports_bbs/59P5ONN700051QVF.html">查看全部</a></h6>
    </div>
    <div class="pkContent">             <div class="tip"><span class="name">网易福建厦门网友：</span><span class="ip">210.13.214.146</span><span class="time">2009-05-22 15:57:48.0 发表</span></div>
      <div class="content"> 曼联必胜,巴塞死忙 
        <!-- <div class="reply"><a href="javascript:replyFun('v1')"  target="_self">回复</a></div> -->
      </div>
            <div class="tip"><span class="name">网易江苏苏州网友：</span><span class="ip">121.236.45.152</span><span class="time">2009-05-22 15:57:40.0 发表</span></div>
      <div class="content"> 相信曼联
        <!-- <div class="reply"><a href="javascript:replyFun('v1')"  target="_self">回复</a></div> -->
      </div>
            <div class="tip"><span class="name">网易广东深圳福田网友：</span><span class="ip">219.133.255.242</span><span class="time">2009-05-22 15:44:51.0 发表</span></div>
      <div class="content"> 虽然我也是车迷，不过，觉得球赛要赢，还是应该凭实力。，“不管是天意还是人为”，想要扼杀英超吗？做梦！！曼联必胜！！捍卫英超！！
        <!-- <div class="reply"><a href="javascript:replyFun('v1')"  target="_self">回复</a></div> -->
      </div>
            <div class="tip"><span class="name">网易河南洛阳网友：</span><span class="ip">123.7.59.17</span><span class="time">2009-05-22 15:39:47.0 发表</span></div>
      <div class="content"> 巴萨打不过就玩阴的 曼联的实力最强 C罗 加油！