644 Open source projects that are alternatives of or similar to proxi

Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)

Tool to scrape linkedin

Subdomain method that proxies websockets, XMLHttpRequests, and more.

Crawly, a high-level web crawling & scraping framework for Elixir.

Reverse HTTP proxy that works on Linux, Windows, and macOS. Made with C++ and Boost.

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

Python分布式爬虫打造搜索引擎

Collection of useful data science topics along with code and articles

Serverless selenium which dynamically execute any given code.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

A Selenium-driven tool for automated website interaction and scraping.

Linkedin Learning videos downloader

A Python Tool For google Hacking

A scrapy middleware to use rotated proxy ip list.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

proxy checker to check the status of the ip-port proxy list

📇 Extract social media profiles and more with regular expressions

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

Generate Free Edu Mail(s) within minutes

Using scrapy to scrape tripadvisor in order to get users' reviews.

Easily crawl news portals or blog sites using Storm Crawler.

Pythonic HTML Parsing for Humans™

Functional HTML scraping and rewriting with CSS in OCaml

Analyze scraped data

Mechanize is a ruby library that makes automated web interaction easy.

Redirecting Load Balancer

📷 An app to scrap instagram posts and analyze data.

A local development http proxy with hosts spoofing written in Go

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

Open Graph Protocol Parser for Node.js

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

Generate JSON representations of HTML tables

The web browser that's built for scraping.

Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.

A PHP Scraping Class

This is a project of build knowledge graph course. The project leverages historical stock price, and integrates social media listening from customers to predict market Trend On Dow Jones Industrial Average (DJIA).

Intelligent Web Data Extractor

Download images from reddit

Perform lexical analysis on words, one word at a time.

python+scrapy+splash 爬取拉勾全站职位信息

Extract data or evaluate value from HTML/XML documents using XPath

Hi there will be a lot of proxies here.

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

This class can retrieve search results from Google.

The simplest demo of chrome automation by python and selenium in AWS Lambda

Archive web pages with all relevant assets or save as a single file HTML

Domain based VPN Gateway/Proxy for all devices

Pick the most common user-agents on the Internet 👻

Scrapy project boilerplate done right

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Common interface for data container classes

PHP Scraper - an highly opinionated web-interface for PHP

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

Get info from any web service or page

A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.