5079 Open source projects that are alternatives of or similar to Spidermon

Declarative web scraping

Scrapy, a fast high-level web crawling & scraping framework for Python.

openITCOCKPIT is an Open Source system monitoring tool built for different monitoring engines like Nagios, Naemon and Prometheus.

Sentry is cross-platform application monitoring, with a focus on error reporting.

Cluster monitoring stack for clusters based on Prometheus Operator

Prometheus Operator creates/configures/manages Prometheus clusters atop Kubernetes

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

The Prometheus monitoring system and time series database.

📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

Exceptionless server and jobs

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Prometheus Alertmanager

Nagios check_postgres plugin for checking status of PostgreSQL databases

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Scrape Facebook public pages without an API key

Example end to end data engineering project.

Python framework to scrape Pastebin pastes and analyze them

🔥🐻 The Speakeasy Scripting Engine Which Combines Speed, Safety, and Simplicity

WhatPulse reverse engineered

**[ARCHIVED]** website changes tracker 🔍

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

A Scrapy extension to log items coverage when the spider shuts down

ProxyCrawl Python library for scraping and crawling

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Continuously monitor your AWS services for configurations that can lead to degradation of confidentiality, integrity or availability. All results will be sent to Security Hub for further aggregation and analysis.

Performance Analyzer

A horizontally scalable, highly available, multi-tenant, long term Prometheus.

SQL powered operating system instrumentation, monitoring, and analytics.

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Stop stalking and start StopStalking 😉

Enterprise-Grade Open-Source Network Management Platform

🥫 The simple, fast, and modern web scraping library

A Kubernetes operator for running synthetic checks as pods. Works great with Prometheus!

Distributed crawling framework for documents and structured data.

Linux Kernel Manager and Activity Monitor 🐧💻

Network monitoring system written in Python and Django, designed to be extensible, programmable, scalable and easy to use by end users: once the system is configured, monitoring checks, alerts and metric collection happens automatically.

Displays CI statuses on a dashboard and triggers fun modules representing the status!

🛎️ Monitor the speed your ISP is delivering

🚦Bash script to generate a static status page.

⏰A Prometheus exporter for Hapi, express and Marble.js servers to automatically measure request timings 📊

Elegant Scraper and Crawler Framework for Golang

Tutorial for web scraping / crawling with Node.js.

Server that accepts metrics via the Graphite protocol and exports them as Prometheus metrics

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

A browser testing and web crawling library for PHP and Symfony

An open source web crawling platform

Easily crawl news portals or blog sites using Storm Crawler.

Web crawling and scraping framework for Golang

Community-based GPL-licensed network monitoring system

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

No description or website provided.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Screen scraping and web crawling framework

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

PowerShell script to monitor Active Directory groups and send an email when someone is changing the membership

Crawl sites for RSS, Atom, and JSON feeds.

一个灵活、友好的爬虫框架

Hastic data management server for analyzing patterns and anomalies from Grafana