Diffbot

Diffbot is a visual learning robot that identifies and extracts the important parts of any web page. Use some of our existing API to harvest the most common online content types, or roll your own using the Custom API setup, adaptable to any type of content. If you'd like to harvest entire domains without difficulty, try the Crawlbot and consume thousands of pages in minutes, only to get a neatly structured JSON output as a result.