453 Open source projects that are alternatives of or similar to Sqrape

A framework for creating semi-automatic web content extractors

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

PHP Scraper - an highly opinionated web-interface for PHP

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

PHP Library for detecting CMS

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Scape top GitHub repositories and users based on keywords

Web Scraping Framework

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Go cascadia package command line CSS selector

Turn large Web sites into tables and charts using simple SQLs.

Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

A modern CSS selector implementation for BeautifulSoup

🔥🐻 The Speakeasy Scripting Engine Which Combines Speed, Safety, and Simplicity

⚡️ Ayakashi.io - The next generation web scraping framework

💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R

Python Package for scraping NHL Play-by-Play and Shift data

General Assembly's 2015 Data Science course in Washington, DC

Example end to end data engineering project.

👄 Free image manipulation API service built on top of Sharp (an alternative to Jimp, Graphics Magic, Image Magick, and PhantomJS)

Learn Python for the next 30 (or so) Days.

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Mod inspired by Witchery

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).

📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

Open source process design kit for usage with SkyWater Technology Foundry's 130nm node.

Python framework to scrape Pastebin pastes and analyze them

scan for webcams on the internet

Android app for saving webpages for offline reading.

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

A framework for writing Spark 2.x applications in a pretty way

legacy backend for Open States

Zillow Scraper for Python using Selenium

🕷 Google client for SERPS

Object-Oriented Programming concepts in Python

Open Source Your Password (Mismanagement)!

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Simple web scraping for R

Floki is a simple HTML parser that enables search for nodes using CSS selectors.

Data extraction of Google's COVID-19 Mobility Reports

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

Scrapy, a fast high-level web crawling & scraping framework for Python.

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

ASP.NET View State Decoder

A scalable web crawler framework for Java.

Extract clean(er), readable text from web pages via Mercury Web Parser.

Aligning characters for fun and profit, with Haskell and PureScript

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

htmlSQL is a experimental PHP library which allows you to access HTML values by an SQL like syntax.

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉