1125 Open source projects that are alternatives of or similar to Google Group Crawler

a fast BASH multiple-image downloader

Bitextor generates translation memories from multilingual websites.

PHP/JavaScript file upload web app to upload files from command line & browser, and download them elsewhere. Frequently used to upload/download files on servers. Hosted version is available at bashupload.com.

知乎模拟登录，支持提取验证码和保存 Cookies

wsend: The opposite of wget

Verify that a request is from Google crawlers using Google's DNS verification steps

Download a large file from Google Drive (curl/wget fails because of the security notice).

seamless Proxy Auto-Config (a.k.a. Web Proxy Auto Discovery) for CLI apps

Easily create XML sitemaps for your website.

Like curl, or wget, but downloads directly go to a SQLite databse

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Подсистема 1С для работы с HTTP

Expose your LocalHost with this tool

This repository contains all the code I use in my YouTube tutorials.

Google search results crawler, get google search results that you need

A high-performance, high-stability, cross-platform HTTP client.

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

大学微信查教务成绩 数据抓取 数据分析 微信查成绩 验证码识别 redis缓存

Creates an XML-Sitemap by crawling a given site.

Google, Naver multiprocess image web crawler (Selenium)

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

CurlSharp - .Net binding and object-oriented wrapper for libcurl.

PHP class to use the Google Translator API for free.

Google removed the "View Image" button. This is a bookmarklet that downloads the full-size photo.

🥄 A package for building specific Proxy Pool for different Sites.

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

Marmot workflow execution engine

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

Face-recognition using Siamese network

A React-Native Bridge for the Google Dialogflow (API.AI) SDK

🔥 Mac/Linux Docker LNMP

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

An image crawler written in Python.

A simple distributed crawler for zhihu && data analysis

Crawler for LinkedIn full profiles 2019

A high performance cURL PHP library for running of multiple requests at once, asynchronously

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

WKWebView with cookie sharing support

Join our group to see more

基于 Selenium 的知乎关键词爬虫

A License Classifier

🕷️ A node crawler for github trending.

The Easiest Way To Play/Stream Video And Audio Using Google ExoPlayer In Your Android Application

React Native Wrapper of Google Place Picker for iOS + Android.

Python爬虫代理IP池(proxy pool)

Web crawling framework based on asyncio.

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

科学上网，ss, ssr, v2ray, trojan, clash, clashr，翻墙机场推荐

Google CTF

PHP WHOIS provides parsed and raw whois lookup of domains and ASN routes. PHP 5.4+ and 7+ compatible

Crawl some picture for fun

Script that generates a sitemap by crawling a given URL

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

◼️ Supercharge curl with history, collections and more.

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

Powershell module for Google / G Suite API calls wrapped in handy functions. Authentication is established using a service account via P12 key to negate the consent popup and allow for greater handsoff automation capabilities

All of my completed Android Basics Nanodegree by Google projects.

🔥 比libevent、libuv更易用的国产网络库。A c/c++ network library for developing TCP/UDP/SSL/HTTP/WebSocket client/server.