580 Open source projects that are alternatives of or similar to Nutch

Ansible role used to deliver the Config Encoder Filters.

DevSec Apache Baseline - InSpec Profile

HBase客户端数据管理软件

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

A directory listing theme for Apache

Apache ECharts is a powerful, interactive charting and data visualization library for browser

Mirror of Apache Qpid JMS

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

基于Spark2.2新闻网大数据实时系统项目

네이버 뉴스 수집을 위한 도구

Astronomer Core Docker Images

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Apache Superset is a Data Visualization and Data Exploration Platform

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

A big data platform for analyzing web access logs

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Hadoop WebHDFS output plugin for Fluentd

A Java NIO file system provider for HDFS

서울시 공무원의 업무추진비를 분석하여 진짜 맛집 찾기 프로젝트

Turn large Web sites into tables and charts using simple SQLs.

Hive UDFs for funnel analysis

a reliable high-level web crawling & scraping framework for Node.js.

A curated list of awesome Cordova Apache Plugins https://cordova.apache.org/plugins/

Search for Slack Webhooks token publicly exposed on Github

📅🇨🇳 中国法定节假日数据 自动每日抓取国务院公告

serverless, instagram hashtag crawler with lambda, dynamoDB

An easy way to deploy your Akka services to a distributed environment.

🎯Python 3 网络爬虫实战、数据分析合集 | 当当 | 网易云音乐 | unsplash | 必胜客 | 猫眼 |

Open-source distribute workflow schedule tools, also support streaming task.

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

Mirror of Apache Qpid Dispatch

An Apache httpd module for integrating with Apereo CAS Server project.

Screen scraping and web crawling framework

MySQL to NoSQL real time dataflow

🐘 A local Hadoop cluster bootstrapper using Vagrant, Ansible, and Ambari.

Dumps state of Storm Kafka consumers

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

一个用来快速提取网页内容的信息采集（爬虫）框架， 实现了对网页的动态加载与控制。

Convert .htaccess redirects to nginx.conf redirects

Today I Learned

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Implementation of ModSecurity, Core Rule Set (CRS) on Apache server. ModSecurity, sometimes called Modsec, is an open-source web application firewall. ModSecurity was installed and configured on an Ubuntu VM using Virtual Box

大数据入门指南 ⭐

No description or website provided.

Indonesian stemmer - Pustaka JavaScript untuk mengambil kata dasar dari kata berimbuhan pada bahasa Indonesia.

Mirror of Apache Calcite - Avatica

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

A curated list of awesome puppeteer resources.

More complete Debian environment for Docker

Ansible Role - Apache 2.x.

Easy to use, professional error pages to replace the plaintext error pages that come with any server software like Nginx or Apache

Quick and dirty dynamic redirect.rules generator

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Scalable, redundant, and distributed object store for Apache Hadoop

A simple distributed crawler for zhihu && data analysis