readme.txt

利用广度优先遍历搜索一定范围内的所有网页,可用于建立搜索引擎和查找网络错误.

Prerequisite:

1. PostgreSQL is installed. Make a note of port number, user name, and password during installation.

2. Set up the crawler database using the psql tool and dbsetup.sql file.

	psql -U postgres template 1 -f ./dbsetup.sql

3. Update the parameters in crawler.properties as you want.

4. Execute the program using run.bat.

	run -p<pwd> -o<log file name (optional)>