An intro to serverless and OpenWhisk for Kafka users

© 2019 IBM Corporation
Building serverless apps with Kafka
Dale Lane
An introduction to serverless with Apache OpenWhisk
IBM Event StreamsApache Kafka
@dalelane

Agenda
§ What is “serverless”?
§ Implementations
§ Apache OpenWhisk
§ Demos

What is “serverless”?

Serverless
§An architectural pattern where your code is run:
– in response to events
– only on-demand on a per-request basis

Evolution of deployment patterns
Monolith

Microservice
Microservice
Microservice
Monolith

Function
Function
Function
Function
Function
Function
Function
Function
Microservice
Microservice
Microservice
Monolith

Bare metal Virtual
machines
Containers Orchestration Serverless

Function
FaaS
Platform
PaaS
Infrastructure
IaaS
Container
CaaS
Bare metal

Definition
github.com/cncf/wg-serverless

Definition
applications that do not require server management
applications bundled as one or more functions
[developers] no longer need to spend time and resources on server
provisioning, maintenance, updates, scaling and capacity planning

How is serverless different?
Monolith Microservice
Microservice
Microservice
Function
Function
Function
Function
Function
Function
Function
Function

£ $ €
kr Fr
¥

Example use cases
§ Event processing
§ Data processing
§ Scheduled tasks
§ Scalable REST APIs

The Twelve Factor App

Serverless is good for:
§ Infrequent or sporadic demand
§ Focused, short duration processing
§ Highly dynamic workloads
§ Stateless workloads
§ Inconsistent demand
§ Scheduled infrequent tasks
§ Flexibility

Implementations

Implementations – platform

Implementations – hosted

Implementations – private cloud

Implementations – installable

Implementations
s.cncf.io

Serverless framework
serverless.com/framework

Apache OpenWhisk

OpenWhisk
openwhisk.apache.org

OpenWhisk – who

OpenWhisk – where

OpenWhisk concepts

OpenWhisk concepts
event

OpenWhisk concepts
event action

OpenWhisk concepts
event action
function (eventobj)
{
// do something
return result;
}

OpenWhisk languages

OpenWhisk concepts
event actiontrigger

OpenWhisk concepts
actiontrigger ruleevent

OpenWhisk concepts
actionrule
event
actionrule
actionrule
actionrule
trigger

OpenWhisk concepts
rule
event
rule
rule
rule
trigger
trigger
trigger
trigger
action
event
event
event

OpenWhisk concepts
function main(params) {
return { hello : 'world' };
} hello.js

OpenWhisk concepts
}
$ wsk action create helloworld hello.js
ok: created action helloworld
hello.js

OpenWhisk concepts
}
$ wsk action create helloworld hello.js
ok: created action helloworld
$ wsk action invoke helloworld
ok: invoked /guest/helloworld with id 7df9c9dfbb
hello.js

OpenWhisk actions
blocking
non-blocking

OpenWhisk actions
blocking
non-blocking
periodic

OpenWhisk actions
action action action

OpenWhisk implementation
proxy

proxy controller

proxy controller
store

proxy controller
store
service registry
invoker

proxy controller
store
service registry
invoker
invoker
invoker
invoker
invoker
invoker

controller
invoker
invoker
invoker
invoker
invoker
invoker

Container management
start X
init X X
run X X X
medium.com/openwhisk/squeezing-the-milliseconds-how-to-make-serverless-platforms-blazing-fast-aea0e9951bd0

Resource limits
github.com/apache/incubator-openwhisk

Demos – installable

Deployment options

git clone https://github.com/apache/incubator-openwhisk-devtools.git
cd incubator-openwhisk-devtools/docker-compose
make quick-start

OpenWhisk event providers
trigger ruleevent

cd incubator-openwhisk-devtools/docker-compose
make create-provider-cloudant
make create-provider-kafka

git clone https://github.com/apache/incubator-openwhisk-package-kafka.git
cd incubator-openwhisk-package-kafka
export OPENWHISK_AUTH=$OPENWHISK_HOME/ansible/files/auth.whisk.system
./installKafka.sh $OPENWHISK_AUTH $SYSTEM_IP_ADDR
http://$SYSTEM_IP_ADDR:5984
local_
$SYSTEM_IP_ADDR

Demo
event
Message
produced to
Kafka topic
MY.EVENTS

kafka-topics.sh --create --topic MY.EVENTS
--replication-factor 1 --partitions 1
--zookeeper $SYSTEM_IP_ADDR:3181

Demo
event
Message
produced to
Kafka topic
MY.EVENTS
myKafkaTrigger
trigger

wsk trigger create myKafkaTrigger
-f /whisk.system/messaging/kafkaFeed
-p brokers '["9.174.23.208:3092"]'
-p topic MY.EVENTS

Demo
event
Message
produced to
Kafka topic
MY.EVENTS
myKafkaTrigger
trigger
sendToSlack
action
action

wsk action create sendToSlack slack-action.js

Demo
ruleevent
Message
produced to
Kafka topic
MY.EVENTS
myKafkaTrigger
trigger
slackOnKafkaMessages
sendToSlack
action
action

wsk rule create slackOnKafkaMessages
myKafkaTrigger
sendToSlack

Reminder

Demos – using a hosted service

Demo
Orders Voyages Ships Containers Alerts
VoyagesOrder
Order
Management
Microservice
Fleet/Ships
Simulator
Microservice
Voyages
Management
Microservice
Kafka Streams
Kafka

Demo
ruleevent
Message
produced to
Kafka topic
“alerts”
kafkaAlert
trigger
processAlert
action
action

Orders Voyages Ships Containers Alerts
VoyagesOrder
Order
Management
Microservice
Fleet/Ships
Simulator
Microservice
Voyages
Management
Microservice
Kafka
Kafka Streams

Summary

Summary / roundup
§An architectural pattern where your code is run:
– in response to events
– only on-demand on a per-request basis

Getting started
twitter.com/openwhisk
medium.com/openwhisk
slack.openwhisk.org
youtube.com/channel/UCbzgShnQk8F43NKsvEYA1SA
#openwhisk
developer.ibm.com/code/patterns/category/serverless
serverlessconf.io

Thank you
Dale Lane
Software Engineer, IBM Event Streams
IBM Event Streams - ibm.com/cloud/event-streams
https://slack-invite-ibm-cloud-tech.mybluemix.net/

An intro to serverless and OpenWhisk for Kafka users

More Related Content

What's hot (16)

Similar to An intro to serverless and OpenWhisk for Kafka users (18)

More from Dale Lane (20)

Recently uploaded (20)

An intro to serverless and OpenWhisk for Kafka users