www.times.com.html

linux下的网页抓取与分析源码

<li id="navNYRegion"><a href="http://www.nytimes.com/pages/nyregion/index.html">N.Y./Region</a></li>
<li id="navBusiness"><a href="http://www.nytimes.com/pages/business/index.html">Business</a></li>
<li id="navTechnology"><a href="http://www.nytimes.com/pages/technology/index.html">Technology</a></li>
<li id="navSports"><a href="http://www.nytimes.com/pages/sports/index.html">Sports</a></li>
<li id="navScience"><a href="http://www.nytimes.com/pages/science/index.html">Science</a></li>
<li id="navHealth"><a href="http://www.nytimes.com/pages/health/index.html">Health</a></li>
<li id="navOpinion"><a href="http://www.nytimes.com/pages/opinion/index.html">Opinion</a></li>
<li id="navArts"><a href="http://www.nytimes.com/pages/arts/index.html">Arts</a>
<ul>	
<li><a href="http://www.nytimes.com/pages/books/index.html">Books</a></li>	
<li><a href="http://movies.nytimes.com">Movies</a></li>	
<li><a href="http://www.nytimes.com/pages/arts/music/index.html">Music</a></li>	
<li><a href="http://www.nytimes.com/pages/arts/television/index.html">Television</a></li>	
<li><a href="http://theater.nytimes.com">Theater</a></li>	
</ul>
</li>
<li id="navStyle"><a href="http://www.nytimes.com/pages/style/index.html">Style</a>
<ul>
<li><a href="http://www.nytimes.com/pages/dining/index.html">Dining & Wine</a></li>
<li><a href="http://www.nytimes.com/pages/fashion/index.html">Fashion & Style</a></li>
<li><a href="http://www.nytimes.com/pages/garden/index.html">Home & Garden</a></li>
<li><a href="http://www.nytimes.com/pages/fashion/weddings/index.html">Weddings/ Celebrations</a></li>
</ul>
</li>
<li id="navTravel"><a href="http://travel.nytimes.com">Travel</a></li>
</ul>
<div class="columnGroup">						
<ul>
<li class="NavGroupTwo-firstchild"><a href="http://www.nytimes.com/ref/topnews/blog-index.html">Blogs</a></li>
<li><a href="http://laughlines.blogs.nytimes.com/">Cartoons /<br/>Humor</a></li>
<li><a href="http://listings.nytimes.com/classifiedsmarketplace/">Classifieds</a></li>
<li><a href="http://www.nytimes.com/corrections.html">Corrections</a></li>
<li><a href="http://www.nytimes.com/pages/crosswords/index.html">Crossword/ Games</a></li>
<li><a href="http://firstlook.nytimes.com">First Look</a></li>
<li><a href="http://www.nytimes.com/learning/index.html">Learning Network</a></li>
<li><a href="http://www.nytimes.com/pages/multimedia/index.html">Multimedia</a></li>
<li><a href="http://travel2.nytimes.com/top/features/travel/destinations/unitedstates/newyork/newyorkcity/guide.html">NYC Guide</a></li>
<li><a href="http://www.nytimes.com/pages/obituaries/index.html">Obituaries</a></li>
<li><a href="http://www.nytimes.com/ref/multimedia/podcasts.html">Podcasts</a></li>
<li><a href="http://www.nytimes.com/top/opinion/thepubliceditor/index.html">Public Editor</a></li>
<li><a href="http://www.nytimes.com/pages/magazine/index.html">Sunday Magazine</a></li>
<li><a href="http://video.on.nytimes.com/">Video</a></li>
<li><a href="http://www.nytimes.com/pages/weekinreview/index.html">Week in Review</a></li>
<li><a href="http://www.nytimes.com/weather">Weather</a></li>
</ul>
</div>
<div class="columnGroup">
<ul>
<li class="newspaper">SERVICES</li>
<li><a href="http://select.nytimes.com/mem/tnt.html">My Alerts</a></li>
<li><a href="http://www.nytimes.com/nytmobile/">NYT Mobile</a></li>
<li><a href="http://www.nytimes.com/nytstore/">NYT Store</a></li>
<li><a href="http://timesfile.nytimes.com/">Times File</a></li>
<li><a href="http://select.nytimes.com/gst/timesreader.html?vendor=XQNNE070036&excamp=XQNNE070036">Times Reader</a></li>
</ul>
</div>
<div class="columnGroup">
<ul>
<li class="newspaper">NEWSPAPER</li>
<li><a href="https://www.nytimesathome.com?MediaCode=W16AH">Get Home Delivery</a></li>
<li><a href="http://homedelivery.nytimes.com">Customer Care</a></li>
<li><a href="http://www.timespoints.com">TimesPoints</a></li>
<li><a href="http://ad.doubleclick.net/clk;82315659;15985394;a?https://www.nytimesee.com?MediaCode=Internal&CampaignName=nytimes">Electronic Edition</a></li>
<li><a href="http://www.nytco.com/community/">Community Affairs</a></li>
<li><a href="http://www.nytimes.com/events/">Events</a></li>
</ul>
</div>

<div class="columnGroup">
<ul class="advertisementThumbnails">
<li><!-- ADXINFO classification="box_86x60" campaign="nytnyt-Site4Day"--><A HREF="http://www.nytimes.com/adx/bin/adx_click.html?type=goto&page=homepage.nytimes.com/index.html&pos=Bottom3&camp=nytnyt-Site4Day&ad=CollectibleCarsContest86x60-CC3-vote.gif&goto=http%3A%2F%2Fcollectiblecars%2Enytimes%2Ecom%2FContest%2FVote%2Easp%3Fmkt%3DAU%2DD%2DI%2DNYT%2DAD%2DS4D%2DCC3%2DROS%2D1107%2DNA%26WT%2Emc%5Fid%3DAU%2DD%2DI%2DNYT%2DAD%2DS4D%2DCC3%2DROS%2D1107%2DNA%26WT%2Emc%5Fev%3Dclick" target="_blank"><IMG SRC="http://graphics8.nytimes.com/adx/images/ADS/15/88/ad.158812/CollectibleCarsContest86x60-CC3-vote.gif" BORDER=0 ></A></li>




</ul>
</div>
</div>

</td>
<td colspan="2" id="PromoABC">


</td>
</tr>
<tr>		
<td id="abColumns">
<div class="abColumn breakingNewsAlert">
	Breaking News
	<span class="timestamp">1:04 AM ET:</span>
	<h2>Pakistani President Pervez Musharraf Steps Down as Army Chief</H2>
</div>
<!-- #breakingNewsAlert -->
	 


<!--START A and B Columns -->


<div id="rightSpan">
<div class="aColumn">





<div class="kicker">News Analysis</div>
<h3>
<a href="http://www.nytimes.com/2007/11/28/washington/28assess.html?hp">A Large Shadow Cast by an Absent Country</a>    
</h3>
<div class="story" id="topStoryContinuedA">
<div class="byline">By STEVEN ERLANGER</div>
<p class="summary">
There is enormous relief among the many Sunni Arab countries that the U.S. has re-engaged in what they see as the larger battle for Muslim hearts and minds.
</p>

<ul  class="refer">
<li  class="free"><a href="http://www.nytimes.com/2007/11/28/washington/28mideast.html?hp">Israel and Palestinians Set Goal of a Treaty in 2008</a></li>
<li  class="free">Bush's Remarks: <a href="http://www.nytimes.com/2007/11/27/world/middleeast/27cnd-prexytext.html">Text</a> | <a href="http://video.on.nytimes.com/?fr_story=60b1da9df0da4bfb8fe3fff59048595077e734f5"> Video</a></li>
<li  class="free"><script src="http://graphics8.nytimes.com/packages/html/multimedia/js/swfobject.js"></script>
<script src="http://graphics8.nytimes.com/packages/html/multimedia/js/NYTInlineEmbed.js" ></script>
<script>
mm.DI = true;
mm.LI = true;
mm.AH = "Back Story With  Steven Lee Myers";
mm.AD = "298";
mm.AU = "http://graphics8.nytimes.com/podcasts/2007/11/27/28backstory-myers.mp3";
mm.IU = "";
writePlayer();
</script></li>
</ul>

</div>


<div class="columnGroup">



<div class="story">
<div class="kicker">The Long Run</div>
<h5>
<a href="http://www.nytimes.com/2007/11/28/us/politics/28york.html?hp">Senate Race That Fizzled Honed Skills for