898 Open source projects that are alternatives of or similar to Scrapysharp

Universal scrapping tool, which allows you to extract data using multiple environments

No description or website provided.

Extract emails from a given website

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Scraping the status of WhatsApp contacts

simple multi-level scraper json input/output for Cheerio

scrapers for building your own image databases

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

Command line program to download documents from web portals.

A Python Tool For google Hacking

Distributed crawler powered by Headless Chrome

[Unmaintained] A simple and clean video/music/image downloader 👾

Creating Scrapy scrapers via the Django admin interface

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

**[ARCHIVED]** website changes tracker 🔍

This class can retrieve search results from Google.

A PHP Scraping Class

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Elegant Scraper and Crawler Framework for Golang

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

Crawly, a high-level web crawling & scraping framework for Elixir.

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Pahe.ph [Pahe.in] Movies Website Scraper

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

ProxyCrawl Python library for scraping and crawling

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

🕸 List of mini projects that involve web scraping 🕸

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Parse a human name string into salutation, first name, middle name, last name, suffix.

✂️ High performance, multi-threaded image scraper

No description or website provided.

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A Scraper, Downloader, & Recorder for static open directories.

Declarative web scraping

Extract structured data from web sites. Web sites scraping.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Search for and retrieve US Patent and Trademark Office Patent Data

PHP Scraper - an highly opinionated web-interface for PHP

The REST API for Jikan

Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

The Elegant Parser

An blazing fast 100% spec compliant, incremental javascript parser written in Typescript

An Objective-C framework for your everyday HTML needs.

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

Headless Chrome For Java （Java 爬虫）

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.