1036 Open source projects that are alternatives of or similar to 4chan Downloader

一个使用Electron-Vue编写的免登录下载微博图片的桌面爬虫应用

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

（已跑路）百度贴吧吧务管理工具，自动扫描帖子并处理违规帖

基金投资管理回测引擎

Some scrapy and web.py exmaples

A command line tool to download Android applications directly from the Google Play Store by specifying their package name (an initial one-time configuration is required)

爬虫, http代理, 模拟登陆!

Bootstrap 4.4 offline documentation

Storage-agnostic streaming library for binary data transfers

HTTP API for Scrapy spiders

docker of aria2 & webui

Torrent client for iOS 9.3+

Video Downloader for Termux .

Forked from https://sf.net/p/fmd/

A free programming font with cursive italics and ligatures. Donations welcome ❤️

a macOS native app/widget for aria2 download tool.

A simple but powerful anime downloader and streamer.

获取免费socks/https/http代理的网站集合

Ruby script to fetch subtitles on Addic7ed (auto-downloader)

🔥 launch app from web page（调起app、调用端能力、下载app、环境判断、复制）

GUI based offensive penetration testing tool (Open Source)

Viewers for statistics and dashboarding of Domain Search Engine data

视频边下边播播，把播放器播放过的数据流缓存到本地，支持拖动。采用avplayer

Simple nodejs package to download torrents using torrent-indexer and webtorrent, especially movie and series.

Free Web Scraping Tool with Java

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

API of DouYin for Humans used to Crawl Popular Videos and Musics

Powerful web scraping framework for Crystal

A search application to explore, discover and share online files

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

safari extension for use aria2 to replace safari default download

优雅地玩知乎

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

Download any song mp3 with no dependencies except ffmpeg

Largest list of models for Core ML (for iOS 11+)

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》

aria2 is a lightweight multi-protocol & multi-source, cross platform download utility operated in command-line. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink.

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

Script for downloading Coursera.org videos and naming them.

Redis-based components for Scrapy.

A multipurpose whatsapp bot buillt on node.js

支援 PTT 還有 PTT2 的 PTT API

The best file downloader library for Android

Digger is a powerful and flexible web crawler implemented by pure golang

Scrapes Reddit to download media of your choice.

Parser and database to index the terpene profile of different strains of Cannabis from online databases

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

a new crawler based on python with more function including Network fingerprint search

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频

Incredibly fast crawler designed for OSINT.

🌐 One-click script to synchronize files from Canvas LMS.

An Aggregator Engine for searching and downloading movies free - NO ADs!

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

How to download from Mega.nz with IDM - Unlimited

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

Very customizable imageboard/booru downloader with powerful filenaming features.

利用文本挖掘技术进行新闻热点关注问题分析

💐 Full Amazon Automatic Download