398 Open source projects that are alternatives of or similar to Videoserver

Powerful web scraping framework for Crystal

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

DownZemAll! is a download manager for Windows, MacOS and Linux

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

优雅地玩知乎

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Multithreading download all HD photos / pictures from someone's Sina Weibo album.

An R web crawler and scraper

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》

line-bot-tutorial use python flask

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频

The simple, easy to use command line web crawler.

字体混淆服务

A fast tool to fetch URLs from HTML attributes by crawl-in.

When you solve the problem of Baekjoon Online Judge, it automatically commits and pushes to the remote repository.

模拟登录各类网站，操作 API 完成各种不可描述的事情

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Simple Weibo Scraper

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

读书笔记《自己动手写网络爬虫》，自己敲的代码。主要记录了网络爬虫的基本实现，网页去重的算法，网页指纹算法，文本信息挖掘

A powerful dynamic crawler for web vulnerability scanners

A fluent and functional approach to querying HTML

用 node.js 爬你自己的 leetcode 解题源码

Crawl a website and take screenshots

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

Leetcode Contest Ranking Searcher

Videodl: A lightweight video downloader written by pure python.

根据关键词抓取微博数据，再生成词云

tw.pycon.org/2017/events/talk/314386410792550475/

Get the lyrics for the song currently playing on Spotify

无cookie版微博爬虫，可以连续爬取一个或多个新浪微博用户信息、用户微博及其微博评论转发。

（已跑路）百度贴吧吧务管理工具，自动扫描帖子并处理违规帖

🐤️ Lost Ark wait notifier

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), SPAs (Single Page Applications), and other websites based on top of front-end JavaScript frameworks

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

A Python DNS crawler to find identical domain names under different TLDs.

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

Google search results crawler, get google search results that you need - php

获取免费socks/https/http代理的网站集合

High performance crawler for Nodejs

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Continuous scalable web crawler built on top of Flink and crawler-commons

Dynamic meta tags in your AngularJS single page application

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

golang light-weight image crawler

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Github 仓库及用户分析爬虫

A simple distributed crawler for zhihu && data analysis

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

A simple but powerful web crawler library for .NET

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis