110 Open source projects that are alternatives of or similar to Webscrapping

Projeto de calculo de Imposto de Renda em operacoes na bovespa automaticamente. Tags:canal eletronico do investidor, CEI, selenium, bovespa, IRPF, IR, imposto de renda, finance, yahoo finance, acao, fii, etf, python, crawler, webscraping, calculadora ir

This email crawler will visit all pages of a provided website and parse and save emails found to a csv file.

Phomber is infomation grathering tool that reverse search phone numbers and get their details, written in python3.

News extraction and scraping. Article Parsing

robots.txt file parsing and checking for R

Make a ZIM file from any Web site and surf offline!

An Introduction to Web Scraping

Script for checking changes in webpages

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

Web scraper project to collect the useful Hong Kong weather data from HKO website

API for fetching data from news websites.

web scraping in parallel with Selenium Grid and Docker

Let's you to access your FB account from the command line and returns various things number of unread notifications, messages or friend requests you have.

Android Web Scraper is a simple library for android web automation. You can perform web task in background to fetch website data programmatically.

An R web crawler and scraper

This repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using…

Scrape your favorite Anime from Okanime.com without effort

A Dragnet that also extract author, headline, date, keywords from context

Take the hassle out of web scraping

A VS code Extension to accelerate the process of solving problems on Codeforces.

🗽 NY Times is an Minimal News 🗞 iOS app 📱 built to describe the use of SwiftSoup and CoreData with SwiftUI🔥

GUI app for downloading whole online courses with folder structure from one url

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

Automatically creates a Youtube channel dashboard

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

An image scraper that scraps images from unsplash.com

No description or website provided.

A Simple, LightWeight, Statically-Typed Python3 API wrapper for GogoAnime.

Colossus Repository for Kodi Addons - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Torrent Api ✨

Blog do Brasil.IO

Suck the InTernet

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

Download all the ebooks with indexed csv of "allitebooks.com"

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.

Schedules tweets using TweetDeck

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

CLI program that collects information from facebook user profiles via Selenium.

R interface to Python requests module

A python web scraper for public email lists.

Pawn package manager for SA-MP

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

extract videos from youtube in audio format using webscraping techniques 🎶

Physical Bitcoin Stat Ticker

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

a class that uses scraped proxies to make http GET/POST requests (Python requests)

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

Python wrapper for the unofficial scraped API of the satori testing system.

Using Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.

An Artificial Intelligence Chat Bot and Service Provider written in Python and AIML.

PHP Metacritic API - Mirrored by my GitLab

Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.

🥫 The simple, fast, and modern web scraping library

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Covid19 Data API (JSON) - LIVE

a work-in-progress guide to web scraping as an artistic and critical practice