Top 1 news-crawler open source projects

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments