23 Open source projects that are alternatives of or similar to Generalnewsextractor

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

新闻网页正文通用抽取器 Beta 版.

Python 开源项目之「自学编程之路」，保姆级教程：AI实验室、宝藏视频、数据结构、学习指南、机器学习实战、深度学习实战、网络爬虫、大厂面经、程序人生、资源分享。

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

Save content you enjoy!

Java web crawling library

🌈Python3网络爬虫实战：QQ音乐歌曲、京东商品信息、房天下、破解有道翻译、构建代理池、豆瓣读书、百度图片、破解网易登录、B站模拟扫码登录、小鹅通、荔枝微课

链家网爬虫

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

A Unix-style personal search engine and web crawler for your digital footprint.

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Document Search Engine Tool

Multithreaded Konachan / Yandere (moebooru based site) Image Bulk Downloader | 多线程K站Y站下载器

Yummy Recipe Crawler and Search

Bot para monitoramento de promoções no fórum do Hardmob http://www.hardmob.com.br/promocoes/

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

Because Chegg only gave few days to access their solutions for free when I rent their books so I decided to create a web crawler to save all the needed solutions offline.

一个致力于用Python提高部门工作自动化水平的程序库！（包括数据采集、办公自动化、辅助研究、图网络、复杂系统、3D可视化等）

O maior livro de receitas culinárias em língua portuguesa

Python Web Crawler with Selenium and PhantomJS

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

An Efficient ProxyPool with Getter, Tester and Server

🌈Python3网络爬虫实战：淘宝、京东、网易云、B站、12306、抖音、笔趣阁、漫画小说下载、音乐电影下载等