插件简介
web pages are crawled by being loaded into browser using multiple tabs parallelly
WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
1) The current url is used as the starting point, and it's loaded again in a new tab.
2) After this page is loaded, fetch all the links on the page.
3) Get all the links on the page, including relative urls.
4) Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
5) repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider
其他信息
ID aanpchnfojihjddlocpgoekffmjkhbbe
版本 0.0.3 上次更新日期 2019年3月8日 大小 121KiB 语言 支持1
种语言 开发者 适用浏览器
谷歌浏览器、其他Chromium内核的浏览器
来自该开发者的更多内容
Wild Spider Chrome插件下载
为打击盗链困扰，本站已启用人机验证
微信扫码关注左侧公众号，发送“插件”二字获得验证码，验证码5分钟全站有效