All Projects → lbp0200 → ImNotSpider

lbp0200 / ImNotSpider

Licence: Unlicense license
浏览器User Agent生成器

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to ImNotSpider

Faker
A Java port of the Faker ruby gem: https://github.com/stympy/faker/
Stars: ✭ 167 (+882.35%)
Mutual labels:  faker
Foundry
A model factory library for creating expressive, auto-completable, on-demand dev/test fixtures with Symfony and Doctrine.
Stars: ✭ 216 (+1170.59%)
Mutual labels:  faker
CRC-manipulator
Change CRC checksums of your files.
Stars: ✭ 73 (+329.41%)
Mutual labels:  faker
Helpdesk Guide
📖《桌维网管实典》主机与程控终端信息安全运维,IT方向速成就业入职
Stars: ✭ 183 (+976.47%)
Mutual labels:  faker
Charlatan
Create fake data in R
Stars: ✭ 209 (+1129.41%)
Mutual labels:  faker
Faker
Provides fake data to your Android apps :)
Stars: ✭ 234 (+1276.47%)
Mutual labels:  faker
Fake Api Jwt Json Server
A Fake API with JWT Authentication using json-server and jsonwebtoken
Stars: ✭ 151 (+788.24%)
Mutual labels:  faker
randomdata
TYPO3 extensions to generate new random data or replace existing data with random data
Stars: ✭ 14 (-17.65%)
Mutual labels:  faker
Joal
An open source command line RatioMaster with an optional WebUI.
Stars: ✭ 213 (+1152.94%)
Mutual labels:  faker
react-useragent
Higher order component to add user agent information to your react components
Stars: ✭ 13 (-23.53%)
Mutual labels:  useragent
Graphql Faker
🎲 Mock or extend your GraphQL API with faked data. No coding required.
Stars: ✭ 2,361 (+13788.24%)
Mutual labels:  faker
Fake Apache Log Generator
Generate a boatload of Fake Apache Log files very quickly
Stars: ✭ 207 (+1117.65%)
Mutual labels:  faker
Casual
Fake data generator for javascript
Stars: ✭ 2,793 (+16329.41%)
Mutual labels:  faker
Fake2db
Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.
Stars: ✭ 2,113 (+12329.41%)
Mutual labels:  faker
jRand
A Java library to generate random data for all sorts of things. Java random data faker
Stars: ✭ 27 (+58.82%)
Mutual labels:  faker
Faker Bot
A tool to make it easier to pick the right Faker methods to generate the fake data you need. 🔍
Stars: ✭ 158 (+829.41%)
Mutual labels:  faker
Node Mock Server
File based Node REST API mock server
Stars: ✭ 225 (+1223.53%)
Mutual labels:  faker
useragent-generator
Easily generate correct user-agent strings for popular browsers
Stars: ✭ 62 (+264.71%)
Mutual labels:  useragent
mockingbird
🐦 Decorator Powered TypeScript Library for Creating Mocks
Stars: ✭ 70 (+311.76%)
Mutual labels:  faker
dummy
Run mock server based off an API contract with one command
Stars: ✭ 170 (+900%)
Mutual labels:  faker

ImNotSpider浏览器User Agent生成器

demo

Python3.5下测试通过

from ImNotSpider import ImNotSpider as imsp
ins = imsp.ImNotSpider()
#随机
ua = ins.random()
ua = ins.pc()
ua = ins.wap()
ua = ins.pc_linux()
ua = ins.pc_windows()
ua = ins.pc_mac()
ua = ins.internet_explorer()#Windows PC
ua = ins.chrome_pc()
ua = ins.chrome_pc_linux()
ua = ins.chrome_pc_mac()
ua = ins.chrome_pc_windows()
ua = ins.firefox_pc()
ua = ins.firefox_pc_linux()
ua = ins.firefox_pc_mac()
ua = ins.firefox_pc_windows()
ua = ins.android()
ua = ins.iphone()
ua = ins.chrome_wap()
ua = ins.chrome_wap_android()
ua = ins.chrome_wap_iphone()
ua = ins.wechat()
ua = ins.wechat_android()
ua = ins.wechat_iphone()
ua = ins.uc_browser_android() #UC浏览器
ua = ins.baidu_box_app() #手机百度
ua = ins.baidu_box_app_android()
ua = ins.baidu_box_app_iphone()

其他语言(Java、PHP等)

使用https://github.com/lbp0200/ImNotSpiderWebAPI,搭建一个Web接口,调用Web接口即可

安装

pip install git+https://github.com/lbp0200/ImNotSpiderWebAPI.git

爬虫经验分享

很多网站判断爬虫,一般用IP+UserAgent。本项目主要解决UserAgent问题,但是个别变态(low)的 网站使用IP来判断,这样会有一个很大的问题。比如二级运行商(长城宽带、方正宽带、宽带通)或者移动 都是使用NAT网络,说白了,就是整个帝都长城宽带就是一个超级局域网,访问某个网站都是同一个IP, 这就给爬虫留下机会,比如把爬虫通过长城宽带来抓内容,难不成网站要把整个帝都长城宽带都封掉?有资源 的朋友可以分享下经验。

动态IP的常见解决方案:

ADSL拨号

淘宝有很多这样的服务器售卖

代理IP

有免费和付费的,免费的不够稳定,原理很简单,到发布免费代理的网站抓,然后测试或在使用时扔掉失败次数超过N的。 付费的也不少,搜索“代理IP API”,一大把,没有推荐,因为我也没用过。

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].