466 Open source projects that are alternatives of or similar to videodl

中国大陆大学列表爬虫

A Tumblr Blog Backup Application

抖音SDK

Elasticsearch File System Crawler (FS Crawler)

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目

dynamic crawler for web vulnerability scanner

Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

Life is short, *****.

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

[Unmaintained] A simple and clean video/music/image downloader 👾

An Open Source Search Engine

A high performance web crawler in Elixir.

Creates an XML-Sitemap by crawling a given site.

🐾 Creeper - The Next Generation Crawler Framework (Go)

대량의 뉴스 데이터를 수집하기 위해 만들어진 뉴스 크롤러입니다.

✌️ Python3 BitTorrent DHT crawler

Twitter bot to help you download videos and gifs

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

This repository is no longer maintained.

HTTP API for Scrapy spiders

Web crawler.

A multi-thread crawler framework with many builtin image crawlers provided.

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

一个超级轻量的百度图片爬虫

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

Simple but useful Python web scraping tutorial code.

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

A Tumblr Backup Application

Fess is very powerful and easily deployable Enterprise Search Server.

Digger is a powerful and flexible web crawler implemented by pure golang

基于搜狗微信搜索的微信公众号爬虫接口

抖音去水印、快手去水印、微博、网易云音乐视频解析接口

A Facebook crawler

As you can see, a kuaishou crawler

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

Official Algolia Plugin for Netlify. Index your website to Algolia when deploying your project to Netlify with the Algolia Crawler

带你了解一下Golang的市场行情

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

Doujinshi downloader 绅士漫画下载

抖音数据抓取

A collection of awesome web crawler,spider in different languages

GUI based offensive penetration testing tool (Open Source)

Declarative web scraping

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

Crawler for Nintendo Switch eShop

Download Videos Skill Share per ID or per Class

Python的基础练习代码与各种爬虫代码

A Video downloader for Bilibili 用来下载b站视频的工具 使用的是b站旧版flash播放api 暂无更新计划

简单易用的Python爬虫框架，QQ交流群：597510560

Easy way to brute-force web directory.

Crawling CV conference papers with Python.

Fetching hotel data from TripAdvisor.

High performance crawler for Nodejs

iOS markdown Note App / iOS的markdown笔记应用

Google search results crawler, get google search results that you need

Bitextor generates translation memories from multilingual websites.

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)