705 Open source projects that are alternatives of or similar to App_comments_spider

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

抓取网易云音乐热门评论

Pholcus is a distributed high-concurrency crawler software written in pure golang

Dark Web OSINT Tool

A simple comment system based on LeanCloud and Valine. 👉

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

Life is short, *****.

基于搜狗微信搜索的微信公众号爬虫接口

python爬虫

cfmt is a tool to wrap Go comments over a certain length to a new line.

一个简单的豆瓣信息爬虫😄

Gospider - Fast web spider written in Go

最简单的91porn爬虫php版本

爬取百度百科中文页面，抽取三元组信息，构建中文知识图谱

Scrapy middleware to handle javascript pages using selenium

Parse code context in a single line of javascript, for functions, variable declarations, methods, prototype properties, prototype methods etc.

A high performance web crawler in Elixir.

Redis-based components for Scrapy.

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

Cuckoo Filter implementation in Go, better than Bloom Filters (unmaintained)

带你了解一下Golang的市场行情

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

go patterns

A scrapy spider that scraps times and prices from Voyages Sncf. It uses scrapyrt to provide an API interface.

🐾 Creeper - The Next Generation Crawler Framework (Go)

Random User-Agent middleware based on fake-useragent

A collection of awesome web crawler,spider in different languages

Possibly the best practice of Scrapy 🕷 and renting a house 🏡

Web 端反爬技术方案

use multiple proxies with Scrapy

A python3 package for writing spider more easily.

两只蠢萌京东的分布式爬虫.

WordPress plugin that lets you use Discourse as the community engine for a WordPress blog

🎬 基于Pyqt5的简单电影搜索工具

Parse and output TODOs and FIXMEs from comments in your files

A framework for creating semi-automatic web content extractors

QQ空间导出助手，用于备份QQ空间的说说、日志、私密日记、相册、视频、留言板、QQ好友、收藏夹、分享、最近访客为文件，便于迁移与保存

Export all folders and documents from Quip

A golang spider

哔哩哔哩的API调用模块

汤不热 python 多线程爬虫

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

TweetScraper is a simple crawler/spider for Twitter Search without using API

Threaded comments for Symfony

Python的基础练习代码与各种爬虫代码

Scraping scripts for various websites.

📰 Brazilian government gazettes, accessible to everyone.

Crawly, a high-level web crawling & scraping framework for Elixir.

Html网页正文提取

Mouthful is a self-hosted alternative to Disqus

🔮 A lightweight comments widget built on GitHub issues

Extract JavaScript code comments from a string or glob of files.

开箱即用的SpringMVC项目,包含常规业务所需的框架功能整合，更多功能请关注 https://github.com/MartinDai/SpringBoot-Project

QQZone mood spider and analysis. QQ空间多线程爬虫和数据挖掘。提供线上服务，扫码登陆即可自动爬取和分析数据，还有网易云年度报告风格的数据展示；使用docker-compose打包程序，方便部署；额外提供QQ空间抽奖小程序。

常见工具汇总：一键式生成整个前后端工具，单机高性能幂等工具，zookeeper客户端工具，分布式全局id生成器，一致性哈希工具，Bitmap工具，布隆过滤器参数生成器，Yaml和properties互转工具等等

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览:https://mo.fish

📺 B 站全站视频信息爬虫

👽 OneBlog，一个简洁美观、功能强大并且自适应的Java博客

The FASTEST QUALITY hash function, random number generators (PRNG) and hash map.