134 Open source projects that are alternatives of or similar to Rvest

Content based movie recommendation system with sentiment analysis

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

UI.Vision: Open-Source RPA Software (formerly Kantu) - Modern Robotic Process Automation with Selenium IDE++

Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go

No description or website provided.

Nextjs server to query websites with GraphQL

Audio Book scrapper

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

API to get user details for competitive coding platforms - Codeforces, Codechef, SPOJ, Interviewbit

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Random User-Agent middleware based on fake-useragent

🚆This web scraper builds a dataset for São Paulo subway operation status

Go cascadia package command line CSS selector

Simple search for organisations participating/participated in the GSoC

List of libraries, tools and APIs for web scraping and data processing.

Scape top GitHub repositories and users based on keywords

Snoop — инструмент разведки на основе открытых данных (OSINT world)

Scraping Ebay's products using Scrapy Web Crawling Framework

NBA Stats API via Basketball Reference

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Collection of scripts corresponding to LucidProgramming YouTube tutorials

[Python] Scraps comics and manga from various websites and creates cbz files from them

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Explaining textual analysis tools in Python. Including Preprocessing, Skip Gram (word2vec), and Topic Modelling.

Faster requests on Python 3

Computational Thinking for Social Scientists book project

Powerful web scraping framework for Crystal

📖 Using deep learning and scraping to analyze/summarize articles! Just drop in any URL!

The Python Code Tutorials

A web scraping tool to systematically extract the text of scientific papers and corresponding metadata from university accessible journals.

A Router WiFi key recovery/cracking tool with a twist.

A Docker tutorial using a link extraction application example

A JavaScript library for generating random user agents with data that's updated daily.

🇺🇸 Is the US flag at half-staff?

Extract clean(er), readable text from web pages via Mercury Web Parser.

Materials to reproduce our findings in our stories, "Amazon Puts Its Own 'Brands' First Above Better-Rated Products" and "When Amazon Takes the Buy Box, it Doesn’t Give it up"

A framework for creating semi-automatic web content extractors

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

📈 Regression and Classification with UC Davis student quiz data and exam data

Heroshi – open source web crawler.

Python binding to Modest engine (fast HTML5 parser with CSS selectors).

Tableau scraper python library. R and Python scripts to scrape data from Tableau viz

Headless 'Chrome' Orchestration in R

Text Mining for Indonesian Online News Articles About Corona

ACHE is a web crawler for domain-specific search.

WhatsApps related deaths News Articles along with other articles across India during that period

Node.js framework for modular web scraping and data extraction

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

PHP Library for detecting CMS

Receive an email or Telegram message as soon as Migros Sanalmarket is available for delivery in your neighborhood.

Fetch user's data across social media

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.