431 Open source projects that are alternatives of or similar to selectorlib

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Scape top GitHub repositories and users based on keywords

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

🕸→ℹ️ Reap Information from Websites

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

HTML scraping for Objective-C.

PHP Library for detecting CMS

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Extract data or evaluate value from HTML/XML documents using XPath

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

PHP Scraper - an highly opinionated web-interface for PHP

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

A framework for creating semi-automatic web content extractors

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Web Scraping Framework

🌎 🏨 Scrape Booking.com 🏨 🌎

Automation for Kivy Application

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

📊 Python tool to scrape real-time information about ETFs from the web and mixing them together by proportionally distributing their assets allocation

The API for Furaffinity you wish existed

A Scrapy extension to log items coverage when the spider shuts down

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

Bulk Downloader for Reddit

Overwatch API library for player details and career stats

scrapers for building your own image databases

A website dedicated to making recipes from any website easy to read.

给uiautomatorview添加xpath等待

The simplest demo of chrome automation by python and selenium in AWS Lambda

Instagram Photo Downloader

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

covers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈

Stock Market Predictor with LSTM network. Web scraping and analyzing tools (ohlc, mean)

**[ARCHIVED]** website changes tracker 🔍

Use Puppeteer to download pens from Codepen.io as single html pages

With Selenium headless browsing and CAPTCHA solving

Web scraping Page Objects core library

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

🦀 Scraping & crawling websites using Rust, and ReasonML

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

The complete web scraping toolkit for PHP.

Tutorial for web scraping / crawling with Node.js.

You can use this act to monitor any page's content and get a notification when content changes.

🤖 A Versatile Telegram Bot

Crawlzone is a fast asynchronous internet crawling framework for PHP.

TestCafe selector extensions for Vue.js apps.

EXQuery repository

Pillaging the seven seas for torrents, pieces of eight and other bounty.

🐓 An opinionated guide on how to test Redux ducks

xpath.js - Open source XPath 2.0 implementation in JavaScript (DOM agnostic)