All Projects → apengda → Fiflow

apengda / Fiflow

flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0

Programming Languages

java
68154 projects - #9 most used programming language

Projects that are alternatives of or similar to Fiflow

Athenax
SQL-based streaming analytics platform at scale
Stars: ✭ 1,178 (+1078%)
Mutual labels:  sql, flink, streaming
Materialize
Materialize lets you ask questions of your live data, which it answers and then maintains for you as your data continue to change. The moment you need a refreshed answer, you can get it in milliseconds. Materialize is designed to help you interactively explore your streaming data, perform data warehousing analytics against live relational data, or just increase the freshness and reduce the load of your dashboard and monitoring tasks.
Stars: ✭ 3,341 (+3241%)
Mutual labels:  sql, streaming
Flink Sql Cookbook
The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.
Stars: ✭ 189 (+89%)
Mutual labels:  sql, flink
Bigdata Notebook
Stars: ✭ 100 (+0%)
Mutual labels:  flink, streaming
Flinkstreamsql
基于开源的flink,对其实时sql进行扩展;主要实现了流与维表的join,支持原生flink SQL所有的语法
Stars: ✭ 1,682 (+1582%)
Mutual labels:  sql, flink
Pulsar Flink
Elastic data processing with Apache Pulsar and Apache Flink
Stars: ✭ 126 (+26%)
Mutual labels:  sql, flink
Alchemy
给flink开发的web系统。支持页面上定义udf,进行sql和jar任务的提交;支持source、sink、job的管理;可以管理openshift上的flink集群
Stars: ✭ 264 (+164%)
Mutual labels:  sql, flink
df data service
DataFibers Data Service
Stars: ✭ 31 (-69%)
Mutual labels:  streaming, flink
Flink Training Course
Flink 中文视频课程(持续更新...)
Stars: ✭ 3,963 (+3863%)
Mutual labels:  flink, streaming
Beam
Apache Beam is a unified programming model for Batch and Streaming
Stars: ✭ 5,149 (+5049%)
Mutual labels:  sql, streaming
Streaming Readings
Streaming System 相关的论文读物
Stars: ✭ 554 (+454%)
Mutual labels:  flink, streaming
Flink Spector
Framework for Apache Flink unit tests
Stars: ✭ 190 (+90%)
Mutual labels:  flink, streaming
Streamline
StreamLine - Streaming Analytics
Stars: ✭ 151 (+51%)
Mutual labels:  flink, streaming
Quicksql
A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources
Stars: ✭ 1,821 (+1721%)
Mutual labels:  sql, flink
Flink Learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Stars: ✭ 11,378 (+11278%)
Mutual labels:  flink, streaming
Sylph
Stream computing platform for bigdata
Stars: ✭ 362 (+262%)
Mutual labels:  sql, flink
Eventql
Distributed "massively parallel" SQL query engine
Stars: ✭ 1,121 (+1021%)
Mutual labels:  sql, streaming
Kamu Cli
Next generation tool for decentralized exchange and transformation of semi-structured data
Stars: ✭ 69 (-31%)
Mutual labels:  sql, flink
Bat interviews
📘 分享最新BAT面试题(包含机器学习,Linux,PHP,大数据,Python,Java,前端...),持续更新ing...
Stars: ✭ 1,346 (+1246%)
Mutual labels:  sql
Contacts
A flutter project with Implementation of a Contacts app in 4 ways (API, Custom, Preferences and Sqflite).
Stars: ✭ 100 (+0%)
Mutual labels:  sql

基于flink的数据流处理系统

  基于 apache flink1.10

如何运行

如何使用

在输入框中输入 help 给出提示信息;

如何使用

  • demo mysql : jdbc 示例
  • demo kafka : kafka 示例
  • demo elasticsearch : elasticsearch 示例
  • demo mysql-binlog : mysql-binlog 示例 doing

模块划分

  • fiflow-ui web页面 sql的执行 和 任务的创建 管理
  • fiflow-web 与前端对应的后台
  • fiflow-api fiflow 对外提供的操作api
  • fiflow-core flink 操作的封装
  • fiflow-io 输入 输出
  • fiflow-runtime 提交任务到flink local、standalone、yarn 以及与flink集群的交互

fiflow-io

  • Elasticsearch 读写

    支持谓词下推和异步维表join, 按 shard 分片读取数据
    支持append和retract写(90% complete)

  • mysql binlog doing

  • hbase todo

  • ... todo

todo

  • flink 集群管理
  • 任务管理
  • 使用 数据源管理功能 取代 create table 操作

Thanks

  • flink
  • zeppelin
  • spring boot
  • flinkx
  • vue
  • element-ui
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].