Awesome Flink

A curated list of awesome things related to Apache Flink. Inspired by Awesome Hadoop and Awesome Vue.

• Packages
  • Notebooks
  • Machine Learning
  • Complex Event Processing
  • Interfaces
  • Connectors
  • Benchmarks
  • Tests
• Resources
  • Official Resources
  • External Resources
  • Community
  • Books
  • Papers
  • Blogs
  • Flink Forward
  • Slides

Packages

Notebooks

• Apache Zeppelin - Web-based notebook that enables interactive data analytics with plugable backends, integrated plotting, and extensive Flink support out-of-the-box.

Machine Learning

• Flink-TensorFlow - A library for machine intelligence in Apache Flink™, using the TensorFlow library and associated models.

Complex Event Processing

• Flink-Siddhi - A CEP library for Flink to run Siddhi within Apache Flink streaming application

Interfaces

• Apache Beam - Unified data processing engine supporting both batch and streaming applications. Apache Flink is one of the supported execution environments.

Connectors

• Apache Bahir - Collection of the connectors excluded from Flink (Akka, ActiveMQ, Flume, Netty, Redis).

Benchmarks

• Yahoo! Streaming benchmark
• Yahoo! Streaming benchmark extension

Tests

• Flinnk spector - provides a framework to define unit tests for Apache Flink data flows. The framework executes data flows locally and verifies the output using predefined expectations.

Resources

Various resources, such as books, websites and articles.

Official Resources

• Flink Documentation
• Flink Wiki
• Flink Training

External Resources

• Flink 中文文档
• Flink 中文文档 v1.2 ing...
• Flink 台灣

Community

• Twitter
• Meetups

Books

• Stream Processing with Apache Flink - by Fabian Hueske, Vasiliki Kalavri (Nov 2017)
• Flink in Action - by Sameer Wadkar, Hari Rajaram (Mar 2017)
• Learning Apache Flink - by Tanmay Deshpande (Feb 2017)
• Introduction to Apache Flink - by Ellen Friedman, Kostas Tzoumas (Oct 2016)

Papers

• Lightweight Asynchronous Snapshots for Distributed Dataflows - Paper proposed Asynchronous Barrier Snapshotting (ABS) implemented in Flink to support stateful stream processing. (Jun 2015)
• Apache Flink™: Stream and Batch Processing in a Single Engine - Paper introducing Apache Flink for processing streaming and batch data under a single execution model. (Jan 2015)
• The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing - Paper introducing the Dataflow model which Flink's streaming model based on. (2015)
• Efficient Pattern Matching over Event Streams - Flink CEP library inspired by this paper. (2008)

Blogs

• Official Flink Blog
• The data Artisans Blog
• Flink 原理与实现
• Yanghua's Blog（中文）
• THE MUSINGS OF RAWKINTREVO
• Data Flair
• Building Applications with Apache Flink

Flink Forward

• Flink Forward 2015 - Slides and Videos
• Flink Forward 2016 - Slides and Videos
• Flink Forward San Francisco 2017 - Slides and Videos
• Flink Forward Berlín 2017 - Slides

Slides

2017

• Timo Walther: Table & SQL API – unified APIs for batch and stream processing Flink Forward San Francisco, April 2017: SlideShare
• Kostas Kloudas: Extending Flink’s Streaming APIs Flink Forward San Francisco, April 2017: SlideShare
• Tzu-Li (Gordon) Tai: Joining the Scurry of Squirrels: Contributing to Apache Flink Flink Forward San Francisco, April 2017: SlideShare
• Stefan Richter: Improvements for large state and recovery in Flink Flink Forward San Francisco, April 2017: SlideShare
• Ufuk Celebi: The Stream Processor as a Database: Building Online Applications directly on Streams Flink Forward San Francisco, April 2017: SlideShare
• Jamie Grier: Apache Flink - The Latest and Greatest Flink Forward San Francisco, April 2017: SlideShare
• Stephan Ewen: Experiences running Flink at Very Large Scale Flink Forward San Francisco, April 2017: SlideShare
• Stephan Ewen: Convergence of real-time analytics and data-driven applications Flink Forward San Francisco, April 2017: SlideShare
• Till Rohrmann: Redesigning Apache Flink’s Distributed Architecture Back to Sessions overview Flink Forward San Francisco, April 2017: SlideShare
• Timo Walther: Table & SQL API - unified APIs for batch and stream processing Apache Flink Meetup Amsterdam, March 2017: SlideShare
• Kostas Kloudas: Extending Flink's Streaming APIs Apache Flink Meetup Berlin, February 2017: SlideShare
• Fabian Hueske: Stream Analytics with SQL on Apache Flink Big Data Tech Summit, Warsaw February 2017: SlideShare

2016

• Stephan Ewen: Stream Processing as a Foundational Paradigm and Apache Flink's Approach to It Big Data, Berlin v 10.0, December 2016: SlideShare
• Kostas Tzoumas & Stephan Ewen: Keynote -The maturing data streaming ecosystem and Apache Flink’s accelerated growth Flink Forward, Berlin September 2016: SlideShare
• Robert Metzger: Connecting Apache Flink to the World - Reviewing the streaming connectors Flink Forward, Berlin September 2016: SlideShare
• Till Rohrmann & Fabian Hueske: Declarative stream processing with StreamSQL and CEP Flink Forward, Berlin September 2016: SlideShare
• Jamie Grier: Robust Stream Processing with Apache Flink Flink Forward, Berlin September 2016: SlideShare
• Jamie Grier: The Stream Processor as a Database- Building Online Applications directly on Streams Flink Forward, Berlin September 2016: SlideShare
• Till Rohramnn: Dynamic Scaling - How Apache Flink adapts to changing workloads Flink Forward, Berlin September 2016: SlideShare
• Stephan Ewen: Running Flink Everywhere Flink Forward, Berlin September 2016: SlideShare
• Stephan Ewen: Scaling Apache Flink to very large State Flink Forward, Berlin September 2016: SlideShare
• Aljoscha Krettek: The Future of Apache Flink Flink Forward, Berlin September 2016: SlideShare
• Fabian Hueske: Taking a look under the hood of Apache Flink's relational APIs Flink Forward, Berlin September 2016: SlideShare
• Kostas Tzoumas: Streaming in the Wild with Apache Flink Hadoop Summit San Jose, June 2016: SlideShare
• Stephan Ewen: The Stream Processor as the Database - Apache Flink Berlin Buzzwords, June 2016: SlideShare
• Till Rohrmann & Fabian Hueske: Streaming Analytics & CEP - Two sides of the same coin? Berlin Buzzwords, June 2016: SlideShare
• Robert Metzger: A Data Streaming Architecture with Apache Flink Berlin Buzzwords, June 2016: SlideShare
• Stephan Ewen: Continuous Processing with Apache Flink Strata + Hadoop World London, May 2016: SlideShare
• Stephan Ewen: Streaming Analytics with Apache Flink 1.0 Flink NYC Flink, May 2016: SlideShare
• Ufuk Celebi: Unified Stream & Batch Processing with Apache Flink. Hadoop Summit Dublin, April 2016: SlideShare
• Kostas Tzoumas: Counting Elements in Streams. Strata San Jose, March 2016: SlideShare
• Jamie Grier: Extending the Yahoo! Streaming Benchmark. Flink Washington DC Meetup, March 2016: SlideShare
• Jamie Grier: Stateful Stream Processing at In-Memory Speed. Flink NYC Meetup, March 2016: SlideShare
• Robert Metzger: Stream Processing with Apache Flink. QCon London, March 2016: SlideShare
• Vasia Kalavri: Batch and Stream Graph Processing with Apache Flink. Flink and Neo4j Meetup Berlin, March 2016: SlideShare
• Maximilian Michels: Stream Processing with Apache Flink. Big Data Technology Summit, February 2016: SlideShare
• Vasia Kalavri: Single-Pass Graph Streaming Analytics with Apache Flink. FOSDEM, January 2016: SlideShare
• Till Rohrmann: Streaming Done Right. FOSDEM, January 2016: SlideShare

2015

• Till Rohrmann: Streaming Data Flow with Apache Flink (October 29th, 2015): SlideShare
• Stephan Ewen: Flink-0.10 (October 28th, 2015): SlideShare
• Robert Metzger: Architecture of Flink's Streaming Runtime (ApacheCon, September 29th, 2015): SlideShare
• Robert Metzger: Click-Through Example for Flink's KafkaConsumer Checkpointing (September, 2015): SlideShare
• Paris Carbone: Apache Flink Streaming. Resiliency and Consistency (Google Tech Talk, August 2015: SlideShare
• Andra Lungu: Graph Processing with Apache Flink (August 26th, 2015): SlideShare
• Till Rohrmann: Interactive data analytisis with Apache Flink (June 23rd, 2015): SlideShare
• Gyula Fóra: Real-time data processing with Apache Flink (Budapest Data Forum, June 4th, 2015): SlideShare
• Till Rohrmann: Machine Learning with Apache Flink (March 23th, 2015): SlideShare
• Marton Balassi: Flink Streaming (February 26th, 2015): SlideShare
• Vasia Kalavri: Large-Scale Graph Processing with Apache Flink (FOSDEM, 31st January, 2015): SlideShare
• Fabian Hueske: Hadoop Compatibility (January 28th, 2015): SlideShare
• Kostas Tzoumas: Apache Flink Overview (January 14th, 2015): SlideShare

2014

• Kostas Tzoumas: Flink Internals (November 18th, 2014): SlideShare
• Marton Balassi & Gyula Fóra: The Flink Big Data Analytics Platform (ApachecCon, November 11th, 2014): SlideShare
• Till Rohrmann: Introduction to Apache Flink (October 15th, 2014): SlideShare

License

This work (Awesome Flink, by https://github.com/wuchong/awesome-flink), identified by Jark Wu, is free of known copyright restrictions.