1051 Open source projects that are alternatives of or similar to Sentinel Crawler

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

Important security headers for koa

A scalable web crawler framework for Java.

一个超级轻量的百度图片爬虫

👀 Monitor those builds! 🔨 (No TeamCity plugin needed!)

A single-user blog built with vue2, koa2 and mongodb which supports Server-Side Rendering

VIS components for a security system, to monitor the state and confirm the system's health running.

An ultra fast cross-platform multiple screenshots module in pure Python using ctypes.

基于 Vue + Element 的响应式后台模板

API of DouYin for Humans used to Crawl Popular Videos and Musics

A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)

A search application to explore, discover and share online files

C#多线程编程实战

Fess is very powerful and easily deployable Enterprise Search Server.

A system monitor written in Rust and C

基于搜狗微信搜索的微信公众号爬虫接口

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

Data ETL & Analysis on the dataset 'Baby Names from Social Security Card Applications - National Data'.

A web crawler (for bug hunting) that gathers more than you can imagine.

一个基于 react-native + mobx + socket.io + node 的仿微信 JS-Wechat

Kafka consumer lag monitor

A Facebook crawler

新浪微博相册大图多线程爬虫。

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

Get the lyrics for the song currently playing on Spotify

支援 PTT 還有 PTT2 的 PTT API

一只优雅的正方教务系统爬虫。

Zentral is an open-source solution for infrastructure monitoring and endpoint event stream processing. It provides build-in orchestration of macOS security components (Santa, Osquery, et-al.), event correlation and event management. It consolidates its features with various data store backends (ElasticStack, Azure Log Analytics, Splunk, et-al.).

基于NodeJS的基金数据爬虫，爬取的数据存于github的@nullpointer/fund-data。

《Koa.js 设计模式-学习笔记》已完结 😆

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Doujinshi downloader 绅士漫画下载

RSS-Anything, get updates about anything you can reach with an url. Like RSS, but for anything.

a new crawler based on python with more function including Network fingerprint search

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

A collection of awesome web crawler,spider in different languages

PHP ETL (Extract / Transform / Load) library with SOLID principles + almost no dependency.

🐨实时监控1000家中国企业的新闻动态

tumblr解析网站

《Koa2进阶学习笔记》已完结🎄🎄🎄

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware.

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

A framework for creating semi-automatic web content extractors

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!

An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, ZOJ, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

POSIX Shell script to quickly manage monitors on X

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

A Vue.js project for "零食商贩"

Simple Koa Boilerplate for APIs

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

GraphQL is a new way of communicating with your server. It eliminates the problems of over- and under-fetching, incorporates strong data types, has built-in introspection, documentation and deprecation capabilities, and is implemented in many programming languages. This all leads to gloriously low-latency user experiences, better developer experiences, and much increased productivity. Because of all this, GraphQL is typically used as a replacement for (or companion to) RESTful API services.

scrapy专利爬虫（停止维护）

Cross-platform persistent and distributed web crawler 🔗

A kernel network manager with monitoring and limiting capabilities for macOS. #nsacyber

Koa2 + Typescript = Koatty. Use Typescript's decorator implement IOC and AOP.