885 Open source projects that are alternatives of or similar to Googlescraper

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

💐 Full Amazon Automatic Download

네이버 뉴스 수집을 위한 도구

Discover hidden deepweb pages

Wikiman is an offline search engine for manual pages, Arch Wiki, Gentoo Wiki and other documentation.

2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

APIs for loginning some websites by using requests.

A GUI client of schannel powered by therecipe/qt and golang

A fast full-text search library for Objective-C

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

Sample of using proxies to crawl baidu search results.

Web Crawler written in C#

Pick the most common user-agents on the Internet 👻

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

Knowledge Management for Humans using Machine Learning & Tags

Crawler for leboncoin.fr

用 node.js 爬你自己的 leetcode 解题源码

Search for and retrieve US Patent and Trademark Office Patent Data

java framework for prerender

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

PHP Scraper - an highly opinionated web-interface for PHP

Google SEO研究及流量变现

🔍A simple extension for VSCode to search online easily using search engine.

Crawler used to crawl papers

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

Tor website crawler (specific for Alphabay at the time)

🎬 电影资源爬虫,电影图片抓取脚本,Flask|Nginx|wsgi

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。

Exposing the Hebrew Text Database of the ETCBC

Golang爬虫 爬取豆瓣电影Top250

Crawl websites for accessibility issues from the command line.

Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.

支持Lucene5/6/7/8+版本, 长期维护。

Distributed Image Search Engine Crawler

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

Better Search WordPress plugin

GraphQuery is a query language and execution engine tied to any backend service.

获取最新可备案域名列表爬虫

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Implements the crawler package into Symfony

A full-text search and indexing server written in Rust.

massive SQL injection vulnerability scanner

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

Blast is a full text search and indexing server, written in Go, built on top of Bleve.

Search plugins for the search feature

Scraping scripts for various websites.

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

PHP Library for detecting CMS

A Python implementation of the BM25 ranking function.

Norconex HTTP Collector is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.

a puppeteer walker 🕷 🕸

POOPAK - TOR Hidden Service Crawler

MM131网站图片爬取 🚨

Python: An all-in-one Web Crawler, Web Parser and Web Scrapping library!

ASP.NET View State Decoder