4615 Open source projects that are alternatives of or similar to Infinitycrawler

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Continuous scalable web crawler built on top of Flink and crawler-commons

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Scrapy, a fast high-level web crawling & scraping framework for Python.

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

简单易用的Python爬虫框架，QQ交流群：597510560

Declarative web scraping

The simple, easy to use command line web crawler.

A collection of awesome web crawler,spider in different languages

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

A simple distributed crawler for zhihu && data analysis

Easy way to brute-force web directory.

Rust Web Crawler saving pages on Redis

Parser and database to index the terpene profile of different strains of Cannabis from online databases

Find leaked secrets via github search

Kogito examples - Kogito is a cloud-native business automation technology for building cloud-ready business applications.

🚀 Extensible Angular 11+ enterprise-grade project generator

In case you want to contribute, ping on https://gitter.im/NITSkmOS/algo.

Elixir library used to capture MJPEG video on a Raspberry Pi using the camera module.

Fusion is for now an idea about how to grow Nim's ecosystem without the pain points of more traditional approaches.

Provides assertArraySubset for use in PHPunit

A One Time Password Authentication package, compatible with Google Authenticator.

An Angular wrapper for the site tour library Shepherd

A fast, simple, recursive content discovery tool written in Rust.

Android Secure SharedPreferences Using Facebook Conceal Encryption

Faros is a CRD based GitOps controller

💵 Tool for Brazilian Reais monetary adjustment/correction

JupyterLab plugin for viewing spreadsheets, such as Excel .xls/.xlsx workbooks and OpenOffice .ods files

Development repository for Chef Cookbook iptables

Converts TypeScript definition files (d.ts) to haxe externs (.hx) via the TypeScript compiler API

Laravel package for display diagnostic (config, database, http connections...)

📸 Generates hashtags for Instagram posts. Upload your photo and it will suggest the relevant #hashtags for you. 🏷

A racing game that runs in the terminal

Arc Chart View (Draw Creative Statistic Arc Charts)

Secret and/ credential patterns used for gf.

📊 📈 📉 Project using Quasar framework and ApexCharts.

A GitHub action to sign an APK or AAB

HTTP Frontend For the Joind.in API

北京邮电大学计算机学院本科编程作业索引

Addons for Friendica

🐍 Client library to use the IBM Watson services in Python and available in pip as watson-developer-cloud

Development repository for yum cookbook

Crawl a website and run it through Google lighthouse

Setup and configure r10k for use with git based environments in puppet

Bootstrap 4 Navbar with multiple dropdowns

Geographic calculations for Elixir

Python library for working with the PuppetDB API

Curated list that contain code, snippets or examples without libraries or external packages for developers.

💾 A Node.js module that converts images to ASCII art.

🎨 Example-based texture synthesis written in Rust 🦀

Create pages in SilverStripe using content blocks

Marshmallow library extension that allows schema (de)multiplexing

An app to keep track of different cryptocurrencies, written in dart + flutter