1005 Open source projects that are alternatives of or similar to Querylist

网易云爬虫解决方案

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

An Instagram Scrapper

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

破解JS反爬虫加密参数，已破解中国裁判文书网（2020-06-30更新），淘宝密码，天安保险登录，b站登录，房天下登录，WPS登录，微博登录，有道翻译，网易登录，微信公众号登录，空中网登录，今目标登录，学生信息管理系统登录，共赢金融登录，重庆科技资源共享平台登录，网易云音乐下载，一键解析视频链接，财联社登录。

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

A Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF

Dynamic meta tags in your AngularJS single page application

lots of spider (很多爬虫）

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

Tool to fetch Instagram's public content.

用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

pylinkvalidator is a standalone and pure python link validator and crawler that traverses a web site and reports errors (e.g., 500 and 404 errors) encountered.

Crawler for LinkedIn full profiles 2019

Go process used to crawl websites

Cross-platform persistent and distributed web crawler 🔗

An automated website accessibility scanner and cli

ScraperWiki Python library for scraping and saving data

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Google Search SERP Scraper

java framework for prerender

📢 Ptt 文章通知機器人！Notify Ptt Article in Realtime

🔍 简单的搜索引擎, django 框架

Python爬虫和Flask实现小说网站

爬取百度贴吧、TapTap、appstore、微博官方博主上的游戏评论(基于redis_scrapy)，过滤器采用了bloomfilter。

GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)

Find web directories without bruteforce

Scrapy, a fast high-level web crawling & scraping framework for Python.

The fast website crawler

CoCrawler is a versatile web crawler built using modern tools and concurrency.

File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

scrapy专利爬虫（停止维护）

owllook-小说搜索引擎

A fast and powerfull dashboard (admin) finder

portia-dashboard is a visual web crawler based on scrapinghub/portia

YouTube video downloader in javascript.

抓取豆瓣，bilibili等中的电视剧、电影、动漫演员等信息

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

😩Tool For Taobao/Tmall| 儿时玩具已经过时

A scalable web crawler framework for Java.

滑动验证码，希望对你们有所帮助❤️

Crawler for leboncoin.fr

PHP Scraper - an highly opinionated web-interface for PHP

Web scraper that makes it easier to find real estate in Slovenia.

Unmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege

头条号爬虫案例

一只优雅的正方教务系统爬虫。

Anitop is an unofficial simple API from https://anitrendz.net/ site

一些爬虫的代码

Create agents that monitor and act on your behalf. Your agents are standing by!

A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.

Download website to local directory (including all css, images, js, etc.)

My Python Demo

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

🌐 Web scraping made easy with the visual 🗺 mind map editor to JSON

基于 Laravel 5.2 的小说网站

data resource untuk NLP bahasa indonesia

日常小脚本，懒人欢乐多。

🔥 Shadowsocks 账号爬虫