All Projects → xNathan → squid_proxy_pool

xNathan / squid_proxy_pool

Licence: MIT license
Squid 代理池搭建

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to squid proxy pool

AutoScriptVPS
VPN AutoScript
Stars: ✭ 59 (-32.95%)
Mutual labels:  squid
prom-authzed-proxy
A Prometheus proxy that performs SpiceDB permission checks based on labels
Stars: ✭ 30 (-65.91%)
Mutual labels:  proxy-server
torchestrator
Spin up Tor containers and then proxy HTTP requests via these Tor instances
Stars: ✭ 32 (-63.64%)
Mutual labels:  proxy-server
proxy
An HTTP proxy server written in C# and targeting .NET Core 3.
Stars: ✭ 31 (-64.77%)
Mutual labels:  proxy-server
squid
Development repository for the squid cookbook
Stars: ✭ 27 (-69.32%)
Mutual labels:  squid
Socks5
A full-fledged high-performance socks5 proxy server written in C#. Plugin support included.
Stars: ✭ 331 (+276.14%)
Mutual labels:  proxy-server
mtproxy
Alpine-based Docker Image for Telegram MTProto Proxy
Stars: ✭ 89 (+1.14%)
Mutual labels:  proxy-server
asyncio-socks-server
A SOCKS proxy server implemented with the powerful python cooperative concurrency framework asyncio.
Stars: ✭ 154 (+75%)
Mutual labels:  proxy-server
vcr.js
Mock server with Proxy and Record support inspired by ruby VCR.
Stars: ✭ 41 (-53.41%)
Mutual labels:  proxy-server
terminal
The extendible Shell and SSH terminal, with E2E encryption in the cloud.
Stars: ✭ 29 (-67.05%)
Mutual labels:  squid
thumbai
Go Mod Repository, Go Vanity Server and Proxy Server
Stars: ✭ 84 (-4.55%)
Mutual labels:  proxy-server
blackip
IP Blocklist for Ipset / Squid-Cache
Stars: ✭ 81 (-7.95%)
Mutual labels:  squid
SpoofDPI
A simple and fast anti-censorship tool written in Go
Stars: ✭ 170 (+93.18%)
Mutual labels:  proxy-server
ProxyChecker
proxy checker to check the status of the ip-port proxy list
Stars: ✭ 24 (-72.73%)
Mutual labels:  proxy-server
json-caching-proxy
Node caching HTTP proxy built on top of express-http-proxy. Persists requests and responses to an in-memory HAR-like data structure based on HAR1.2 . Caches JSON content-type responses by default with the ability to cache an entire site; including content-types describing images. Useful for testing front end code, mocking api, and saving the cac…
Stars: ✭ 31 (-64.77%)
Mutual labels:  proxy-server
nginx-reverseproxy
A simple implementation of a multidomain nginx reverse proxy, using Node apps.
Stars: ✭ 46 (-47.73%)
Mutual labels:  proxy-server
bproxy
high-performance minimal HTTP reverse proxy
Stars: ✭ 28 (-68.18%)
Mutual labels:  proxy-server
niftygate
Drop-in Access Control via NFT Ownership
Stars: ✭ 61 (-30.68%)
Mutual labels:  proxy-server
reproxy
Simple edge server / reverse proxy
Stars: ✭ 994 (+1029.55%)
Mutual labels:  proxy-server
docker-openvpn-client
OpenVPN client with killswitch and proxy servers; built on Alpine
Stars: ✭ 217 (+146.59%)
Mutual labels:  proxy-server

squid 代理池搭建

简介

使用squid以及收费代理搭建爬虫代理池,自动获取最新可用代理并写入squid配置文件。

具体介绍及思路参考文章:自己搭建亿级爬虫IP代理池

运行

  1. 备份原始squid配置文件 sudo cp /etc/squid/squid.conf /etc/squid/squid.conf

  2. 购买 站大爷 短效代理 API,修改 zdy.py,将 api_url = 'http://s.zdaye.com/?api=YOUR_API&count=100&fitter=1&px=2' 改为自己的 api 地址

  3. 运行 sudo python zdy.py,由于要写文件和重新加载配置,所以要使用 sudo 运行。

检测

修改 test_proxy.py139.xxx.xxx.66:3188 为自己的 squid 服务器地址,每次运行 test_proxy.py 都会有不同的ip,表明代理搭建成功。

TODO

  • 重构代码,避免使用全局变量
  • 支持多种类型的代理 API 接口,不只限定于站大爷
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].