398 Open source projects that are alternatives of or similar to News_feed

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

台灣上市上櫃股票爬蟲 Taiwan Stock Exchange Crawler

基于NodeJS的基金数据爬虫，爬取的数据存于github的@nullpointer/fund-data。

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

A Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF

No description or website provided.

Incredibly fast crawler designed for OSINT.

Crawl instagram photos, posts and videos for download.

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

LinkedIn Scraper (currently working 2020)

💐 Full Amazon Automatic Download

用 node.js 爬你自己的 leetcode 解题源码

Rust Web Crawler saving pages on Redis

Az összes számlád még egy helyen :)

A python3 crawler for crawling Pixiv ranking top and any illustrator all artworks

A GUI client of schannel powered by therecipe/qt and golang

Android 本地网络小说爬虫，基于jsoup及xpath

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Web Crawler written in C#

🍰 一个可视化的爬虫平台

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

🕷️ A node crawler for github trending.

Crawler for leboncoin.fr

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

Google, Naver multiprocess image web crawler (Selenium)

Web crawling framework based on asyncio.

头条号爬虫案例

Easy way to brute-force web directory.

Scrapy as a Web Crawler for Azure Search Samples

Script that generates a sitemap by crawling a given URL

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

Bitextor generates translation memories from multilingual websites.

Distributed Image Search Engine Crawler

Crawling CV conference papers with Python.

获取最新可备案域名列表爬虫

Polite, slim and concurrent web crawler.

[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.

爬取菜鸟教程网站并转PDF__python_crawer_by_chrome

Android应用市场网络爬虫

JS逆向研究

基于appium的app自动遍历工具

🌀 crawl bilibili user info and video info for data analysis | BiliBili爬虫

👧 美女写真套图爬虫（二）

DownZemAll! is a download manager for Windows, MacOS and Linux

The Last Web Recon Tool You'll Need

The fastest dork scanner written in Go.

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Declarative web scraping

Crawler for Nintendo Switch eShop

Crawly, a high-level web crawling & scraping framework for Elixir.

Core part of NewPipe

Download videos from pornhub.

The simple, easy to use command line web crawler.

Web crawler.

爬虫, http代理, 模拟登陆!