Skip to content

python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录

Notifications You must be signed in to change notification settings

cuiljiang/UrlCrawler

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 

Repository files navigation

UrlCrawler

author : saucerman

description: python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录

说明

暂未使用多进程或多线程,速度不快,可自行修改源码

基本思想如下所示:

About

python写的全站url爬取脚本,爬取网站的全部url用于分析站点目录

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%