liuslnlp / Proxypool
Licence: apache-2.0
跨语言IP代理池,Python实现。
Stars: ✭ 326
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Proxypool
Fp Server
Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器,基于Tornado和Scrapy,在本地搭建属于自己的代理池
Stars: ✭ 154 (-52.76%)
Mutual labels: proxy, proxypool
Free Proxy List
Free proxy list, free proxy world - visit our website
Stars: ✭ 133 (-59.2%)
Mutual labels: proxy, proxypool
Proxypool
An Efficient ProxyPool with Getter, Tester and Server
Stars: ✭ 3,050 (+835.58%)
Mutual labels: proxy, proxypool
Spoon
🥄 A package for building specific Proxy Pool for different Sites.
Stars: ✭ 173 (-46.93%)
Mutual labels: proxy, proxypool
Ok ip proxy pool
🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池
Stars: ✭ 196 (-39.88%)
Mutual labels: proxy, proxypool
Proxybroker
Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS 🎭
Stars: ✭ 2,767 (+748.77%)
Mutual labels: proxy, proxypool
Kubetap
Kubectl plugin to interactively proxy Kubernetes Services with ease
Stars: ✭ 297 (-8.9%)
Mutual labels: proxy
Observable Membrane
A Javascript Membrane implementation using Proxies to observe mutation on an object graph
Stars: ✭ 315 (-3.37%)
Mutual labels: proxy
Socks5
SOCKS Protocol Version 5 Library in Go. Full TCP/UDP and IPv4/IPv6 support
Stars: ✭ 321 (-1.53%)
Mutual labels: proxy
Socks5
A full-fledged high-performance socks5 proxy server written in C#. Plugin support included.
Stars: ✭ 286 (-12.27%)
Mutual labels: proxy
Fiddler Plus
自定义的Fiddler规则,多环境切换、解决跨域开发、快速调试线上代码必备|高效调试分析利器
Stars: ✭ 325 (-0.31%)
Mutual labels: proxy
ProxyPool
注意:请运行程序前先更新一下抓取代理的爬虫。
运行环境
-
Python 3.6
(请务必保证Python的版本在3.6以上,否则异步检验无法使用。)
-
Redis
Redis官网并没有提供Windows的安装版,Windows用户可以点击此处下载一个我自己编译的二进制版本(3.2版本2.7MB,VS 2015编译)。
安装
① 直接使用
安装依赖
$ pip install -r requirements.txt
Windows用户如果无法安装lxml库请点击这里。
打开代理池和API
$ cd proxypool
$ python3 run.py
② 安装使用
安装
$ cd proxypool
$ python setup.py install
打开代理池和API
$ proxypool_run
使用API获取代理
访问http://127.0.0.1:5000/
进入主页,如果显示'Welcome',证明成功启动。
访问http://127.0.0.1:5000/get
可以获取一个可用代理。
访问http://127.0.0.1:5000/count
可以获取代理池中可用代理的数量。
也可以在程序代码中用相应的语言获取,例如:
import requests
from bs4 import BeautifulSoup
import lxml
def get_proxy():
r = requests.get('http://127.0.0.1:5000/get')
proxy = BeautifulSoup(r.text, "lxml").get_text()
return proxy
文件结构
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].