📄 133.txt
字号:
发信人: helloboy (hello), 信区: DataMining
标 题: Re: How to get the website topology
发信站: 南京大学小百合站 (Fri Dec 28 17:23:40 2001), 站内信件
My algorithm is to use a queue to store unanalysed pages.
Then we get one out from queue and create a node ,at the same
time insect its linkage pages into the queue.
Go on this cycle until the queue is empty
But I am still thinking...
because some automated dl images,such as gif,jpg, will make
us annoyed for they make the topology so complicated.
Perhaps I can use some prune algorithm to get rid of
these image files.
【 在 iamgufeng (古风) 的大作中提到: 】
: Can you share your algorithm with us?
: I think it is not very difficult to traverse the website along links
: in pages. but how to identify real/best topology because of the complex
: links between pages. For instance,we all like create links on homepage
: to refer to the important content of other page level. Perhaps we should
: adjust the extracted topology manually.
: 【 在 helloboy (hello) 的大作中提到: 】
: : How to extract it?
: : I have some algorithm.But I 'd like to know whether
: : there are some tools to extract website topology easily.
--
※ 来源:.南京大学小百合站 bbs.nju.edu.cn.[FROM: 202.38.215.15]
⌨️ 快捷键说明
复制代码
Ctrl + C
搜索代码
Ctrl + F
全屏模式
F11
切换主题
Ctrl + Shift + D
显示快捷键
?
增大字号
Ctrl + =
减小字号
Ctrl + -