Flink Community Update February 2015
Download as PPTX, PDF•0 likes•701 views
Flink is an open source stream processing framework. The February 2015 Flink community update announced a bugfix release, a new committer, Flink's participation in Google Summer of Code, and new features in development including a graph API, expression API, and access to secured YARN clusters and HDFS. The update also provided links to blog posts about Flink and a call for testing of a new Python API pull request.
![Flink in the Web
• Blogpost: Flink Streaming [1]
• How Flink Became an Apache Top-Level
Project [2]
• Stale Synchronous Parallelism: the New
Frontier on Apache Flink?[3]
• Distributed data processing with Apache Flink [4]
• Ciao latency, hallo speed [5]
[1] http://flink.apache.org/news/2015/02/09/streaming-example.html
[2] http://dataconomy.com/how-flink-became-an-apache-top-level-project/
[3] https://www.linkedin.com/pulse/stale-synchronous-parallelism-new-frontier-apache-flink-nam-luc-tran
[4] http://www.hadoopsphere.com/2015/02/distributed-data-processing-with-apache.html
[5] http://www.hadoopsphere.com/2015/02/ciao-latency-hallo-speed.html
flink.apache.org 4](https://image.slidesharecdn.com/flinkcommunityupdate-150226035031-conversion-gate02/85/Flink-Community-Update-February-2015-5-320.jpg)
Flink Community Update February 2015
- 1. Apache Flink Flink Community Update February 2015 Robert Metzger [email protected]
- 2. Flink Community Updates • What happened in the Flink community? check out the monthly newsletter on the blog Subscribe to [email protected] 1flink.apache.org
- 3. Whats new? • Bugfix release: 0.8.1 (22 issues resolved) • New committer: Max Michels • Flink is participating in Google Summer of Code 2015 • Flink integration with Samoa (Machine learning on streams from Yahoo!) support is available as a patch. • Direct support for running Flink on Google Compute cloud using Google’s ‘bdutil’ (in Google’s bdutil repository) flink.apache.org 2
- 4. Now in master (0.9-SNAPSHOT) • Graph API “Gelly” • Expression API (presented here last time) • “flink-hcatalog” (convenient access to Hcatalog / Hive tables) • Access to secured YARN clusters / HDFS • A LOT of stability improvements (still, use 0.8.1 if you don’t need newer features) flink.apache.org 3
- 5. Flink in the Web • Blogpost: Flink Streaming [1] • How Flink Became an Apache Top-Level Project [2] • Stale Synchronous Parallelism: the New Frontier on Apache Flink?[3] • Distributed data processing with Apache Flink [4] • Ciao latency, hallo speed [5] [1] http://flink.apache.org/news/2015/02/09/streaming-example.html [2] http://dataconomy.com/how-flink-became-an-apache-top-level-project/ [3] https://www.linkedin.com/pulse/stale-synchronous-parallelism-new-frontier-apache-flink-nam-luc-tran [4] http://www.hadoopsphere.com/2015/02/distributed-data-processing-with-apache.html [5] http://www.hadoopsphere.com/2015/02/ciao-latency-hallo-speed.html flink.apache.org 4
- 6. Python API: Call for Testers • Python API pull request: https://github.com/apache/flink/pull/202 • Implement something, test it on your system and give feedback in the pull request! • Steps to try it out: git clone https://github.com/zentol/incubator-flink.git cd flink git checkout papipr mvn clean install –DskipTests cd <dist> ./bin/pyflink2.sh ../resources/python/flink/example/WordCount.py flink.apache.org 5