827 Open source projects that are alternatives of or similar to Rcrawler

Download Impartus lectures, convert to mkv for offline viewing.

A extensible app for scraping property listings

검색어 기준으로 네이버뉴스와 댓글을 수집하는 파이썬 코드

免登录下载微博图片 爬虫 Download Weibo Images without Logging-in

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

Auto Crawler Ptt Beauty Image Use Python Schedule

Physical Bitcoin Stat Ticker

Scrape everything you can from MyAnimeList.net

No description or website provided.

Dynamic file detection tool based on crawler 基于爬虫的动态敏感文件探测工具

Automatically creates a Youtube channel dashboard

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

A Swift Web Crawler 🕷

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

A simple web scraper built around the JavaFX WebEngine

Torrent Api ✨

Web scraper project to collect the useful Hong Kong weather data from HKO website

Using Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.

dynamic crawler for web vulnerability scanner

🍰 一个可视化的爬虫平台

Creates an XML-Sitemap by crawling a given site.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Web crawler.

电视剧/番剧自动化重命名工具

Scrapes VK user's photos

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

A Python class that scrapes ESRI Rest Endpoints and exports data to a geodatabase

Python wrapper for the unofficial scraped API of the satori testing system.

web scraping in parallel with Selenium Grid and Docker

Simple news aggregator displaying top stories in real time

Download all the ebooks with indexed csv of "allitebooks.com"

Scrapers for many e-SAJ systems

多线程知乎用户爬虫，基于python3

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

golang light-weight image crawler

Page metadata as a service

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Scripts to maintain German law git repository

Non-official Python wrapper and CLI tool for Trainline

Checks USD/PYG exchange rate from several sites, with a calculator, RESTful API and a twitter bot

Covenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

A Dragnet that also extract author, headline, date, keywords from context

Github 仓库及用户分析爬虫

A fast tool to fetch URLs from HTML attributes by crawl-in.

京东App自动登录，在线商品自动下单

An image crawler written in Python.

A Lightweight Weather Scraper

🐝 Web vertical crawler framework for fun

R interface to Python requests module

A simple distributed crawler for zhihu && data analysis

Covid19 Data API (JSON) - LIVE

DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets

🕸 List of mini projects that involve web scraping 🕸

No description or website provided.

NTU CEIBA 資料下載工具

Make a ZIM file from any Web site and surf offline!

단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!

A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!