网页爬虫，httpclient+jericho html parser 实现网页的抓取 - oscar999的专栏 - csdnblog.htm

JMF编程的基础教程。。。 html格式配有源码。。。 非常适合初学者学习

align=top><IMG id=_905_1031_Closed_Image style="DISPLAY: none" 
onclick="this.style.display='none'; document.getElementById('_905_1031_Closed_Text').style.display='none'; document.getElementById('_905_1031_Open_Image').style.display='inline'; document.getElementById('_905_1031_Open_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ContractedSubBlock.gif" 
align=top>&nbsp;&nbsp;}</SPAN></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,0,255)">catch</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;(HttpException&nbsp;e)&nbsp;</SPAN><SPAN 
id=_905_1031_Closed_Text 
style="BORDER-RIGHT: rgb(128,128,128) 1px solid; BORDER-TOP: rgb(128,128,128) 1px solid; DISPLAY: none; BORDER-LEFT: rgb(128,128,128) 1px solid; BORDER-BOTTOM: rgb(128,128,128) 1px solid; BACKGROUND-COLOR: rgb(255,255,255)">...</SPAN><SPAN 
id=_905_1031_Open_Text><SPAN style="COLOR: rgb(0,0,0)">{<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top>&nbsp;&nbsp;&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">//</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">发生致命的异常，可能是协议不对或者返回的内容有问题</SPAN><SPAN 
style="COLOR: rgb(0,128,0)"><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;&nbsp;&nbsp;System.out.println(</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">"</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">Please&nbsp;check&nbsp;your&nbsp;provided&nbsp;http&nbsp;address!</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">"</SPAN><SPAN style="COLOR: rgb(0,0,0)">);<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top>&nbsp;&nbsp;&nbsp;e.printStackTrace();<BR><IMG 
id=_1055_1095_Open_Image 
onclick="this.style.display='none'; document.getElementById('_1055_1095_Open_Text').style.display='none'; document.getElementById('_1055_1095_Closed_Image').style.display='inline'; document.getElementById('_1055_1095_Closed_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedSubBlockStart.gif" 
align=top><IMG id=_1055_1095_Closed_Image style="DISPLAY: none" 
onclick="this.style.display='none'; document.getElementById('_1055_1095_Closed_Text').style.display='none'; document.getElementById('_1055_1095_Open_Image').style.display='inline'; document.getElementById('_1055_1095_Open_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ContractedSubBlock.gif" 
align=top>&nbsp;&nbsp;}</SPAN></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,0,255)">catch</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;(IOException&nbsp;e)&nbsp;</SPAN><SPAN 
id=_1055_1095_Closed_Text 
style="BORDER-RIGHT: rgb(128,128,128) 1px solid; BORDER-TOP: rgb(128,128,128) 1px solid; DISPLAY: none; BORDER-LEFT: rgb(128,128,128) 1px solid; BORDER-BOTTOM: rgb(128,128,128) 1px solid; BACKGROUND-COLOR: rgb(255,255,255)">...</SPAN><SPAN 
id=_1055_1095_Open_Text><SPAN style="COLOR: rgb(0,0,0)">{<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top>&nbsp;&nbsp;&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">//</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">发生网络异常</SPAN><SPAN 
style="COLOR: rgb(0,128,0)"><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;&nbsp;&nbsp;e.printStackTrace();<BR><IMG 
id=_1105_1153_Open_Image 
onclick="this.style.display='none'; document.getElementById('_1105_1153_Open_Text').style.display='none'; document.getElementById('_1105_1153_Closed_Image').style.display='inline'; document.getElementById('_1105_1153_Closed_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedSubBlockStart.gif" 
align=top><IMG id=_1105_1153_Closed_Image style="DISPLAY: none" 
onclick="this.style.display='none'; document.getElementById('_1105_1153_Closed_Text').style.display='none'; document.getElementById('_1105_1153_Open_Image').style.display='inline'; document.getElementById('_1105_1153_Open_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ContractedSubBlock.gif" 
align=top>&nbsp;&nbsp;}</SPAN></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,0,255)">finally</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;</SPAN><SPAN id=_1105_1153_Closed_Text 
style="BORDER-RIGHT: rgb(128,128,128) 1px solid; BORDER-TOP: rgb(128,128,128) 1px solid; DISPLAY: none; BORDER-LEFT: rgb(128,128,128) 1px solid; BORDER-BOTTOM: rgb(128,128,128) 1px solid; BACKGROUND-COLOR: rgb(255,255,255)">...</SPAN><SPAN 
id=_1105_1153_Open_Text><SPAN style="COLOR: rgb(0,0,0)">{<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top>&nbsp;&nbsp;&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">//</SPAN><SPAN 
style="COLOR: rgb(0,128,0)">释放连接</SPAN><SPAN 
style="COLOR: rgb(0,128,0)"><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/InBlock.gif" 
align=top></SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;&nbsp;&nbsp;getMethod.releaseConnection();<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedSubBlockEnd.gif" 
align=top>&nbsp;&nbsp;}</SPAN></SPAN><SPAN style="COLOR: rgb(0,0,0)"><BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedSubBlockEnd.gif" 
align=top>&nbsp;}</SPAN></SPAN><SPAN style="COLOR: rgb(0,0,0)"><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedBlockEnd.gif" 
align=top>}</SPAN></SPAN></DIV></DIV><BR>这样得到的是页面的源代码.<BR>这里<SPAN 
id=_227_1158_Open_Text><SPAN id=_270_1156_Open_Text><SPAN 
id=_554_879_Open_Text><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN 
style="COLOR: rgb(0,0,255)">byte</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">[]&nbsp;responseBody&nbsp;</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">=</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;getMethod.getResponseBoy();是读取内容<BR>除此之外,我们还可以这样读取:<BR>InputStream 
inputStream=&nbsp;&nbsp; getMethod.getResponseBodyAsStream();<BR>String 
responseBody = 
getMethod.getResponseBodyAsString();<BR><BR><BR>下面结合两者给个事例</SPAN></SPAN></SPAN></SPAN><SPAN 
id=_227_1158_Open_Text><SPAN id=_270_1156_Open_Text><SPAN 
id=_554_879_Open_Text><SPAN style="COLOR: rgb(0,0,0)"></SPAN><SPAN 
style="COLOR: rgb(0,0,255)"></SPAN><SPAN style="COLOR: rgb(0,0,0)"></SPAN><SPAN 
style="COLOR: rgb(0,0,0)"></SPAN><SPAN 
style="COLOR: rgb(0,0,0)"></SPAN></SPAN></SPAN></SPAN><BR>取出http://www.ahcourt.gov.cn/gb/ahgy_2004/fyxw/index.html<BR>中"信息快递"栏的前几条信息.<BR>新建类CourtNews<BR>
<DIV 
style="BORDER-RIGHT: windowtext 0.5pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP: windowtext 0.5pt solid; PADDING-LEFT: 5.4pt; BACKGROUND: rgb(230,230,230) 0% 50%; PADDING-BOTTOM: 4px; BORDER-LEFT: windowtext 0.5pt solid; WIDTH: 95%; PADDING-TOP: 4px; BORDER-BOTTOM: windowtext 0.5pt solid; moz-background-clip: -moz-initial; moz-background-origin: -moz-initial; moz-background-inline-policy: -moz-initial">
<DIV><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top><SPAN style="COLOR: rgb(0,0,255)">package</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;test;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;java.io.IOException;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;java.util.ArrayList;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;java.util.Iterator;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;java.util.List;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.DefaultHttpMethodRetryHandler;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.HttpClient;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.HttpException;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.HttpStatus;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.methods.GetMethod;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;org.apache.commons.httpclient.params.HttpMethodParams;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top><BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;au.id.jericho.lib.html.Element;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;au.id.jericho.lib.html.HTMLElementName;<BR><IMG 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;au.id.jericho.lib.html.Segment;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top></SPAN><SPAN style="COLOR: rgb(0,0,255)">import</SPAN><SPAN 
style="COLOR: rgb(0,0,0)">&nbsp;au.id.jericho.lib.html.Source;<BR><IMG alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/None.gif" 
align=top><BR><IMG id=_623_658_Open_Image 
onclick="this.style.display='none'; document.getElementById('_623_658_Open_Text').style.display='none'; document.getElementById('_623_658_Closed_Image').style.display='inline'; document.getElementById('_623_658_Closed_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ExpandedBlockStart.gif" 
align=top><IMG id=_623_658_Closed_Image style="DISPLAY: none" 
onclick="this.style.display='none'; document.getElementById('_623_658_Closed_Text').style.display='none'; document.getElementById('_623_658_Open_Image').style.display='inline'; document.getElementById('_623_658_Open_Text').style.display='inline';" 
alt="" 
src="网页爬虫，HttpClient+Jericho HTML Parser 实现网页的抓取 - oscar999的专栏 - CSDNBlog.files/ContractedBlock.gif"