580 Open source projects that are alternatives of or similar to Nutch

Apache Geode

Viewers for statistics and dashboarding of Domain Search Engine data

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Support TensorFlow on YARN

Prometheus exporter for Apache.

extremely distributed machine learning

An Instagram bot developed using the Selenium Framework

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

The official home of the Presto distributed SQL query engine for big data

Production Ready Data Integration Product, documentation：

HBase客户端数据管理软件

Apache ECharts is a powerful, interactive charting and data visualization library for browser

네이버 뉴스 수집을 위한 도구

Apache Superset is a Data Visualization and Data Exploration Platform

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Turn large Web sites into tables and charts using simple SQLs.

📅🇨🇳 中国法定节假日数据 自动每日抓取国务院公告

An Apache httpd module for integrating with Apereo CAS Server project.

Dumps state of Storm Kafka consumers

Convert .htaccess redirects to nginx.conf redirects

大数据入门指南 ⭐

Mirror of Apache Calcite - Avatica

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

Mirror of Apache Hadoop common

Hop Orchestration Platform

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

基于wifi抓取信息的大数据查询分析系统

GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.

Apache TinkerPop - a graph computing framework

Ephemeral Hadoop clusters using Google Compute Platform

A docker-powered bash script for shared web hosting management. The ultimate Docker LAMP/LEMP Stack.

A client library for Brazilian Correios APIs and services (SIGEP & SRO).

Mirror of Apache Hadoop MapReduce

6개월 치 업무를 하루 만에 끝내는 업무 자동화(생능출판사, 2020)의 예제 코드입니다. 파이썬을 한 번도 배워본 적 없는 분들을 위한 예제이며, 엑셀부터 디자인, 매크로, 크롤링까지 업무 자동화와 관련된 다양한 분야 예제가 제공됩니다.

Repository for Docker Image of Apache-Superset. [Docker Image: https://hub.docker.com/r/abhioncbr/docker-superset]

Mirror of Apache Qpid Proton

Custom state store providers for Apache Spark

Crawler for linguistic corpora

Multiple node cluster on Docker for self development.

Road to Machine Learning

Download DIG to run on your laptop or server.

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

Apache Guacamole installation bash script for RHEL 7 and CentOS 7 including options for Nginx, HTTPS, SSL, LDAP, Let's Encrypt certificates and more

汇总Apache Hudi相关资料

Spark、Flink等离线任务的调度以及实时任务的监控

A collection of awesome web scaper, crawler.

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

Web Crawler

GSSAPI Negotiate module for Apache

Apache Lucene.NET

Apache Tika bindings for PHP: extract text and metadata from documents, images and other formats

🚢 Docker image for Apache Spark

Go process used to crawl websites

A simple tool for fetching usable proxies from several websites.

Mirror of Apache Chukwa

📈 Apache POI for Android

Azure Event Hubs for Apache Kafka Ecosystems

Train TensorFlow models on YARN in just a few lines of code!

Fast, realtime regex-extraction, and aggregation into common formats such as histograms, numerical summaries, tables, and more!