All Projects → Bitwise-01 → Proxies

Bitwise-01 / Proxies

Licence: MIT License
A Simple Proxy Scraper

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Proxies

Proxy Scraper
Proxy-Scraper is simple Perl script for scraping proxies from multiple websites.
Stars: ✭ 24 (-17.24%)
Mutual labels:  scraper, proxies
trackerdog
Generic object change tracker for .NET Framework and .NET Standard-compliant platforms like .NET Core and Xamarin!
Stars: ✭ 85 (+193.1%)
Mutual labels:  proxies
dolarPy
Checks USD/PYG exchange rate from several sites, with a calculator, RESTful API and a twitter bot
Stars: ✭ 45 (+55.17%)
Mutual labels:  scraper
scraper
Scraper example built on Scala, Akka and Jsoup
Stars: ✭ 15 (-48.28%)
Mutual labels:  scraper
munich-scripts
Some useful scripts simplifying bureaucracy
Stars: ✭ 105 (+262.07%)
Mutual labels:  scraper
pluralsight scrapper
A course downloader/scrapper for https://www.pluralsight.com
Stars: ✭ 39 (+34.48%)
Mutual labels:  scraper
html2rss-web
🕸 Generates and delivers RSS feeds via HTTP. Create your own feeds or get started quickly with the included configs.
Stars: ✭ 36 (+24.14%)
Mutual labels:  scraper
MyCrawler
我的爬虫合集
Stars: ✭ 55 (+89.66%)
Mutual labels:  scraper
Instagram-Scraper-2021
Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (+96.55%)
Mutual labels:  scraper
trainline-python
Non-official Python wrapper and CLI tool for Trainline
Stars: ✭ 41 (+41.38%)
Mutual labels:  scraper
bots-zoo
No description or website provided.
Stars: ✭ 59 (+103.45%)
Mutual labels:  scraper
scraper
Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
Stars: ✭ 37 (+27.59%)
Mutual labels:  scraper
SearchScraperAPI
Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.
Stars: ✭ 31 (+6.9%)
Mutual labels:  scraper
SocialInfo4J
fetch data from Facebook, Instagram and LinkedIn
Stars: ✭ 44 (+51.72%)
Mutual labels:  scraper
nepse-data
Extracting data of Nepal Stock Exchange Ltd. (NEPSE)
Stars: ✭ 15 (-48.28%)
Mutual labels:  scraper
ttc subway times
A scraper to grab and publish TTC subway arrival times.
Stars: ✭ 40 (+37.93%)
Mutual labels:  scraper
dijnet-bot
Az összes számlád még egy helyen :)
Stars: ✭ 17 (-41.38%)
Mutual labels:  scraper
facebook-discussion-tk
A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.
Stars: ✭ 33 (+13.79%)
Mutual labels:  scraper
kaa.si-cli
Stream anime from kaa.si and sync with anilist
Stars: ✭ 12 (-58.62%)
Mutual labels:  scraper
weibo-scraper
Simple Weibo Scraper
Stars: ✭ 50 (+72.41%)
Mutual labels:  scraper

A simple proxy scraper

Get ten random proxies

from scraper import Scraper    


if __name__ == '__main__':
scraper = Scraper()    
proxies = scraper.scrape(size=10)  

while proxies.qsize:
proxy = proxies.get()
print(proxy)

Get proxies from Japan

from scraper import Scraper


if __name__ == '__main__':
 scraper = Scraper()    
 proxies = scraper.scrape(country='Japan')
    
 while proxies.qsize:
  proxy = proxies.get()
  print(proxy)

Get three proxies from Japan

from scraper import Scraper


if __name__ == '__main__':
 scraper = Scraper()    
 proxies = scraper.scrape(country='Japan', size=3)
    
 while proxies.qsize:
  proxy = proxies.get()
  print(proxy)

Get SSL proxies

from scraper import Scraper


if __name__ == '__main__':
 scraper = Scraper()    
 proxies = scraper.scrape(protocol='SSL')
    
 while proxies.qsize:
  proxy = proxies.get()
  print(proxy)

Get SOCKS5 proxies

from scraper import Scraper


if __name__ == '__main__':
 scraper = Scraper()    
 proxies = scraper.scrape(protocol='SOCKS5')
    
 while proxies.qsize:
  proxy = proxies.get()
  print(proxy)

Get proxies on port 8080

from scraper import Scraper


if __name__ == '__main__':
 scraper = Scraper()    
 proxies = scraper.scrape(port=8080)
    
 while proxies.qsize:
  proxy = proxies.get()
  print(proxy)
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].