225 Open source projects that are alternatives of or similar to chatnoir-resiliparse

Read Web ARChive (WARC) files in PHP.

Parse And Create Web ARChive (WARC) files with node.js

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

An open-source big data platform designed and optimized for the Internet of Things (IoT).

A Cloud Native Batch System (Project under CNCF)

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Monitor twitter stream

Navigator for Web Archive

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

An end-to-end machine learning and data mining framework on Hadoop

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

bigdatatutorial

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Hayabusa: Simple and Fast Full-Text Search Engine for Massive System Log Data

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Simple-IT-English: smart wordbook from community for community

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

java学习和项目中一些典型的应用场景样例代码

liteflow是一个基于任务版本来实现的分布式任务流调度系统

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

flink学习笔记

大数据分析可视化实践

An open-source, cloud-ready web application for simplified deployment of big data workflows.

MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1

A PHP library to extract article text from web pages

Upserts, Deletes And Incremental Processing on Big Data.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Apache Avro is a data serialization system.

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

🐳 big data study

Python clone of Spark, a MapReduce alike framework in Python

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Pore network extraction from micro-CT images of porous media

TipDM建模平台，开源的数据挖掘工具。

A collection of pentest tools and resources targeting Hadoop environments

Sort files and pack them into partitions

个人笔记集中营，快糙猛的形式记录技术性Notes .. 📚☕️⌨️🎧

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Asynchronous HBase client for NodeJs using REST

Distributed Big Data Orchestration Service

No description or website provided.

技术书籍等

懒松鼠Flink-Boot 脚手架让Flink全面拥抱Spring生态体系，使得开发者可以以Java WEB开发模式开发出分布式运行的流处理程序，懒松鼠让跨界变得更加简单。懒松鼠旨在让开发者以更底上手成本（不需要理解分布式计算的理论知识和Flink框架的细节）便可以快速编写业务代码实现。为了进一步提升开发者使用懒松鼠脚手架开发大型项目的敏捷的度，该脚手架默认集成Spring框架进行Bean管理，同时将微服务以及WEB开发领域中经常用到的框架集成进来，进一步提升开发速度。比如集成Mybatis ORM框架，Hibernate Validator校验框架,Spring Retry重试框架等，具体见下面的脚手架特性。

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Full featured TypeScript Twitter archive reader and browser

A curated list of awesome big data frameworks, ressources and other awesomeness.

Java开发者或者大数据开发者面试知识点整理

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Source code for James Lee's Aparch Spark with Java course

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

JSON mapper for macOS, iOS, tvOS, and watchOS