1792 Open source projects that are alternatives of or similar to Nodespider

Web crawler.

Javascript async flow control manager

☎️ The leading AVM Fritz!Box API for NodeJS and JavaScript.

wrap methods with before/after hooks

Elegant Scraper and Crawler Framework for Golang

Write data to the file system, creating any intermediate directories if they don't already exist. Used by flat-cache and many others!

Simple and modern async event emitter

redis client with typescript and esnext for nodejs

🔥Service level control flow for Node.js

A Promise library for ClojureScript, or a poor man's core.async

Make it easy to develop large, complex Node.js app.

Small, fast, and complete interceptor library for Clojure/Script

JavaScript + BeautifulSoup = JSSoup

🦊 A simple, lightweight & framework agnostic JSON:API client

Asynchronous Programming Library for JavaScript & Node.js

Promise based multipart form parser for KoaJS

一个超级轻量的百度图片爬虫

Tiny library (<200B gzip) for deferring something by a "tick"

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。

Map over promises concurrently

A simple, customizable, and lightweight priority queue for promises.

Implementation of blocking (IO-Bound) cancellable java.util.concurrent.CompletionStage and related extensions to java.util.concurrent.ExecutorService-s

Powerful pipes for TypeScript, that chain Promise and ADT for you 🚌 -> ⛰️ -> 🚠 -> 🏂 -> 🚀

gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。

免费 IP 代理池。Scrapy 爬虫框架插件

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

High performance crawler for Nodejs

Continuous scalable web crawler built on top of Flink and crawler-commons

🐛一只登录正方教务管理系统，爬取数据的小爬虫

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

golang实现的爬虫框架，使用者只需关心页面规则，提供web管理界面。基于colly开发。

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

geetest，滑动验证码

📰 A responsive interface of Hacker News with summaries and thumbnails.

Promise packages, patterns, chat, and tutorials

今日头条机器人，支持用户登陆、关注、取消关注、获取关注粉丝、发文、发悟空问答、点赞、评论、采集各种类型新闻讯息等，使用今日头条网页版API实现

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

a reliable high-level web crawling & scraping framework for Node.js.

Abstraction for managing asynchronous code in JS

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对

Crawly, a high-level web crawling & scraping framework for Elixir.

Html网页正文提取

React custom hooks for async functions with abortability and composability

Sophisticated and functionally-minded async with advanced features: coroutines, promises, ES2015 iterables, fantasy-land

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

Dark Web OSINT Tool

带你了解一下Golang的市场行情

Free Web Scraping Tool with Java

API of DouYin for Humans used to Crawl Popular Videos and Musics

A multi-thread crawler framework with many builtin image crawlers provided.

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

The ES8 Async/Await control flow for Swift

✨强大、优雅的微信小程序异步库🚀

A high performance web crawler in Elixir.

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

多线程知乎用户爬虫，基于python3

磁力網站U3C3介紹以及域名更新

Transpile ES2017 async/await to vanilla ES6 Promise chains: a Babel plugin