111 Open source projects that are alternatives of or similar to Android-Web-Scraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

web scraping in parallel with Selenium Grid and Docker

🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

📲 Bot to help solve HQ trivia

SerpApi client library for Node.js. Previously: Google Search Results Node.js.

🔎Search LinkedIn profile by email address📧

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Pawn package manager for SA-MP

Sometimes we need to scrap web data from our Android App. To achieve this goal jsoup library is a good option. I wrote a blog post on this topic in my personal blog. If you know Bengali language then you can visit this link.

A TikTokBot that downloads trending tiktok videos and compiles them using FFmpeg

Web Scraper in Go, similar to BeautifulSoup

Application for extracting large amounts of data from the Google search results page

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

📚 A GoodReads.com Scraper script to get books reviews including text and rating.

R interface to Python requests module

🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥

Automatically creates a Youtube channel dashboard

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.

This repository contains all the code I use in my YouTube tutorials.

Web Scraping Framework

operating systems three easy pieces by Rezmi

Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel

Scrap Medium Articles using tags.

A php crawler that finds emails on the internets

Code for the second edition Web Scraping with Python book by Packt Publications

[really old and probably doesn't work] Slack bot to post relevant Toronto apartment listings from Kijiji & Craigslist

GUI app for downloading whole online courses with folder structure from one url

A program which takes an Anime name or URL and downloads the specified range of episodes.

A Dragnet that also extract author, headline, date, keywords from context

A library to get images from social media

robots.txt file parsing and checking for R

Rotate between different NordVPN servers with ease. Works both on Linux and Windows without any required changes to your code!

This repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using…

Be nice on the web

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

This email crawler will visit all pages of a provided website and parse and save emails found to a csv file.

Extract price and indicator data from TradingView charts to create ML datasets

Using Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.

Open Source web scraping API. Falkor turns web pages into queryable JSON

Projeto de calculo de Imposto de Renda em operacoes na bovespa automaticamente. Tags:canal eletronico do investidor, CEI, selenium, bovespa, IRPF, IR, imposto de renda, finance, yahoo finance, acao, fii, etf, python, crawler, webscraping, calculadora ir

An extensible API for breaking captchas

No description or website provided.

Github stargazers information gathering tool

A VS code Extension to accelerate the process of solving problems on Codeforces.

ralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.

Helpful Selenium functions to make web-scraping easier and faster

🎬 A Crunchyroll show/season ripper

An Introduction to Web Scraping

Scrapes g4g and creates PDF

Animeflv is a custom API that has the entire catalog of the animeflv.net website. You can enjoy all the content with subtitles in Spanish and the latest in the world of anime for free.

An exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

🌎 🏨 Scrape Booking.com 🏨 🌎

Blog do Brasil.IO

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

extract videos from youtube in audio format using webscraping techniques 🎶