List of Web Scrapers

Community

https://commoncrawl.org/

Commercial

http://scrapinghub.com (scrappy / portia https://github.com/scrapinghub/portia )

https://apify.com / http://apifier.com

https://www.octoparse.com

https://www.webscraper.io

http://www.outwit.com/products/hub/

http://www.fminer.com/


Tools

http://nutch.apache.org/

https://scrapy.org/

Deprecated

http://kimonolabs.com (sold to Sauron)

1 Like