775 Open source projects that are alternatives of or similar to Skill Share Crawler Dl

Simple CORPORA list crawler

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

爬取amazon/bestbuy/costco/6pm 的商品详情

The simple, easy to use command line web crawler.

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

🍿 Free and open-source tech video hub.

Implements the crawler package into Symfony

A fast tool to fetch URLs from HTML attributes by crawl-in.

POOPAK - TOR Hidden Service Crawler

Recursive and multi-threaded broken link checker

massive SQL injection vulnerability scanner

Playlist Quarantine Edition

简单易用的Python爬虫框架，QQ交流群：597510560

我的爬虫合集

Android应用市场网络爬虫

kubernetes container filebrowser and webshell

It covers the blockade principle of most anti-climbing strategies and corresponding solutions.👽👽👽👽（涵盖了大部分的反爬策略的封锁原理以及对应的解决方案。）

Simple Weibo Scraper

Android App for searching for videos on Youtube by keywords using YouTube Data API and download videos from YouTube in different formats.

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

Save Microsoft Stream videos for offline enjoyment.

The fastest YouTube downloader.

A Flutter Plugin for Selecting and Taking New Photos and Videos.

Open source geo based video sharing social app created with Flutter, Supabase and lots of love 💙💙💙

The simple way to download and unrestrict DDL files, torrents and magnets

PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)

Download and Convert YouTube, SoundCloud & Spotify in MP3 with full tags (title, artist, genre, cover, lyrics 🔥)

Source code for the IndieWeb search engine.

爬取北大法宝网http://www.pkulaw.cn/Case/

Download Twitch VODs and Clips

Elasticsearch File System Crawler (FS Crawler)

Crawl a website and take screenshots

开源矢量地理数据获取与预处理工具(POI/AOI/行政区/路网/土地利用)

Who are we? We are the Hunters of all Torrent in this world.🗡️.Fork from SlamDevs

Content-Addressable Data Synchronization Tool

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Download your own Soundcloud tracks (uncompressed)

Crawls a website, gets PageSpeed Insights data for each page, and exports an HTML report.

🍰 一个可视化的爬虫平台

Project thu thập điểm chuẩn đại học 2014 - 2018 và phân tích dữ liệu

Easy way to brute-force web directory.

Dark Web OSINT Tool

Crawling CV conference papers with Python.

APIs for loginning some websites by using requests.

🌀 crawl bilibili user info and video info for data analysis | BiliBili爬虫

Life is short, *****.

A script for The Hylia mass downloads. Get anime soundtracks quickly and easily! Also a Python interface.

A better aria2 desktop frontend than AriaNg, containing all features of AriaNg and more features for desktop.

支援 PTT 還有 PTT2 的 PTT API

A utility package for automating lighthouse reporting

带你了解一下Golang的市场行情

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Aria2 Pro | A perfect Aria2 Docker image | 更好用的 Aria2 Docker 容器镜像

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

Web GUI for youtube-dl

获取免费socks/https/http代理的网站集合