xml.jsp

Heritrix是一个开源,可扩展的web爬虫项目。Heritrix设计成严格按照robots.txt文件的排除指示和META robots标签。

<%@ page import="org.archive.crawler.util.LogReader" %><%
     // If there are empty lines before the start of the xml file Mozilla will
     // not display it properly!
    String inputFile = request.getParameter("file");
    if (inputFile == null) {
        out.println("No file");
        return;
    }
    response.setContentType("text/xml");
    out.println(LogReader.get(inputFile));
%>