This tool is based on original WEB SCRAPER with some more functions:
1. Support MySQL(v5.7+) database.
2. Start scraping from CMD/Terminal.
3. Anti-Lazy Loading.
4. JS Data Filter for data pre process.
5. Remove duplicate insertion.(Only works with https://github.com/hejiheji001/ArrestDB/)
6. Custom Columns*.
7. Easy Scrape
8. Dynamic Urls
9. Progress Tracking
Please check the source code: https://github.com/hejiheji001/web-scraper-chrome-extension
Please check the use cases: https://github.com/hejiheji001/web-scraper-chrome-extension/wiki
Feel free to post issues, requests on my github and star it if you like it.
*: If you use JS Data Filter and changed the structure of your final data, you can define an array of column names to match the new format of your data.
谷歌浏览器、其他Chromium内核的浏览器
为打击盗链困扰,本站已启用人机验证
微信扫码关注左侧公众号,发送“插件”二字获得验证码,验证码5分钟全站有效