mydomain-host-filter

harvest是一个下载html网页得机器人

# Host Filter file for 'mydomain'
#
# Format is
#
#    Allow	regex
#    Deny	regex
#
# Lines are evaulated in order; the first line to match is applied.
#
# 'regex' can be a pattern for a domainname, or IP addresses.
#
Allow	.*\.mydomain\.com		# allow hosts in my FQDN
Allow	^10\.128\.			# allow hosts in IP net 10.128.0.0
Deny    .*				# deny all others