223 Open source projects that are alternatives of or similar to reapr

⏪ Tools to Work with the Various Internet Archive Wayback Machine APIs

🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

➰ ➡️ ➖ Translate cURL command lines into parameters for use with httr or actual httr calls (R)

Scrape, standardize and share public meetings from local government websites

Tutorial: Web scraping in Python with Beautiful Soup

Web scrapping and related analytics using Python tools

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Crawling and scraping the Web for fun and profit

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Web scraping Page Objects core library

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

streaming data parsing and transformation library

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

Exercises, data, and more for our 2017 summer workshop (funded by the Estes Fund and in partnership with Project Jupyter and Berkeley's D-Lab)

Scrapy Training companion code

Tools to work with the Google DNS over HTTPS API in R

Adds XPath command to Cypress test runner

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

MetaData html scraper and parser for Node.js (supports Promises and callback style)

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

A Programming language for Web Scraping

Learn Python for the next 30 (or so) Days.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Use Puppeteer to download pens from Codepen.io as single html pages

Công cụ quét và phân tích từ khoá các trang báo mạng Việt Nam

xpath.js - Open source XPath 2.0 implementation in JavaScript (DOM agnostic)

Selenium-python but lighter: Helium is the best Python library for web automation.

The complete web scraping toolkit for PHP.

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Stock Market Predictor with LSTM network. Web scraping and analyzing tools (ohlc, mean)

Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)

Crawlzone is a fast asynchronous internet crawling framework for PHP.

Web Scraping Framework

VSCode extension for highlighting XSLT and XPath (upto 3.0/3.1)

This repository provides everything you need to get started with Python for (social science) research.

📄◻️ Create, Maniuplate and Extract Data from PDF Files (R Apache PDFBox wrapper)

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Bulk Downloader for Reddit

A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

PHP Scraper - an highly opinionated web-interface for PHP

🌎 🏨 Scrape Booking.com 🏨 🌎

Zillow Scraper for Python using Selenium

An implementation of XPath 3.0 in Objective-C/Cocoa

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

You can use this act to monitor any page's content and get a notification when content changes.

Building a Concurrent Web Scraper with Python and Selenium

⚡️ Ayakashi.io - The next generation web scraping framework

General Assembly's 2015 Data Science course in Washington, DC

给uiautomatorview添加xpath等待

Android app for saving webpages for offline reading.

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

A Devtools driver for web automation and scraping

A web application that generates timetables for university students at the University of Toronto

Web Scraping Framework

Automation for Kivy Application