847 Open source projects that are alternatives of or similar to Taiwan News Crawlers

Incredibly fast crawler designed for OSINT.

Simple Weibo Scraper

🐾 Creeper - The Next Generation Crawler Framework (Go)

A publishing platform for modern newspapers.

Kafa açan içerikler

python requests + Django+ nodejs koa+ mysql to crawl eastmoney fund and stock data,for data analysis and visualiaztion .

Possibly the best practice of Scrapy 🕷 and renting a house 🏡

Uno Crawler por https://douban.com

V2ray看新闻，自动抓取可用节点，以V2ray的机制上网看新闻

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.

An aggregated newspaper app containing news from 10+ local news publishers in Hong Kong. Made with ❤

nayn.co cli news

✌️ Python3 BitTorrent DHT crawler

python-Reptile

A free and open source social news website focusing on computer science and FOSS news for Persian community

PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Source code for the IndieWeb search engine.

🐛一只登录正方教务管理系统，爬取数据的小爬虫

LovePlayNews精仿爱玩iOS app，使用AsyncDisplayKit提高UI流畅性，项目结构及代码清晰明了

a simple & tiny scrapy clustering solution, considered a drop-in replacement for scrapyd

慕课网python分布式爬虫源码-长期更新维护

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

Python + Scrapy + MongoDB . 5 million data per day !!!💥 The world's largest website.

今日头条科技新闻接口爬虫

Project thu thập điểm chuẩn đại học 2014 - 2018 và phân tích dữ liệu

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

A curated list of awesome packages, articles, and other cool resources from the Scrapy community.

Videodl: A lightweight video downloader written by pure python.

Rust Web Crawler saving pages on Redis

基于Scrapy框架的豆瓣电影爬虫

获取最新可备案域名列表爬虫

台灣人到新加坡的工作、生活、簽證申請經驗分享

tw.pycon.org/2017/events/talk/314386410792550475/

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)

Crawling CV conference papers with Python.

Python入门网络爬虫之精华版

🌀 crawl bilibili user info and video info for data analysis | BiliBili爬虫

A python3 crawler for crawling Pixiv ranking top and any illustrator all artworks

Fetching hotel data from TripAdvisor.

一个超级轻量的百度图片爬虫

Let's you to access your FB account from the command line and returns various things number of unread notifications, messages or friend requests you have.

a puppeteer walker 🕷 🕸

A non API python program to crawl public photos, posts or followers

A collection of pipelines for Scrapy

Find web directories without bruteforce

A Python DNS crawler to find identical domain names under different TLDs.

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

知名網站avgle下載器

A document viewer; fuzzy match incremental search.

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

前端每日前沿资讯推送

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Implements the crawler package into Symfony

Crawler (Bot) searching for credential leaks on different paste sites.

Download videos from pornhub.

A template for data journalism in R

🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LPL赛程 台风 梦幻西游、阴阳师藏宝阁 天气 牛客网 百度文库 睡前故事 知乎 Wish

[ Closed ] 🎨 image collector, which supports custom acquisition source configuration and is compatible with MacOS and Windows operating systems.