SlideShare a Scribd company logo
Serverless Architecture with AWS lambda
@itsmemattchung
Agenda
• Brief background about me
• Use Case / Problem
• Live Demo
• Lessons Learned
About Me
Roots in systems and networking. Primary
focus is software development
• Engineer @ Cisco Systems
• Director.Technical Operations @ Fox
Networks (NewsCorp / 21st Century
Fox)
• Python / DevOps @ Whalerock
Industries
What problem are we trying
to solve?
• Scheduled tasks
• Existing solutions
• Cron
• Celery beat
• RQ
What is AWS Lambda
"... a compute service where you can upload your code to AWS Lambda
and the service can run the code on your behalf using AWS
infrastructure."1
-- AWS Developer Guide
1
https://forums.aws.amazon.com/message.jspa?messageID=619362
Attending AWS re:Invent
2015
• Python / Django shop - Celery Beat with single instance scheduler
• Lambda as Cron: Scheduling Invocations in AWS Lambda
• Using CloudWatch to trigger alarm
• SNS topic to trigger AWS Lambda
There's got to be an EASIER way
AWS Announces support for
Cron
A few Core Principles
• Pre-production (i.e "DEV", "QA") and production environments
• Application logging
• Monitoring / Notifications
• Easy to deploy
Live Demo
• Trigger web performance tests on a scheduled basis using
SpeedCurve API.
Sample application
• Build
• Deploy
• Execute
How to separate
environments
Each function is its own "environment"
• DeploySpeedCurve-dev
• DeploySpeedCurve-staging
• DeploySpeedCurve-production
Use Case: Log Ingestion
service
• Akamai Netstorage
• AWS Lambda
• SumoLogic
Things I wished I knew
before
• Language support
• Limitations
Example code
var path = require('path');
path.parse(logfileToUpload)
....
TypeError: Object #<Object> has no method 'parse'
Worked locally, but NOT on AWS Lambda
Supported Languages
• Node.js: v0.10.36
• Java: Java 8
• Python: Python 2.7
Limitations
How to separate environments
Environment Variables
How to separate
environment variables (part
2)
• Download .env-$ENVIRONMENT from S3
• Invoke Build Process
How much did we spend the
last month?
Key Takeaways
• Treat file system as ephemeral
• What language version are you running?
Resources
How to create a deployment package
http://docs.aws.amazon.com/lambda/latest/dg/lambda-python-how-
to-create-deployment-package.html
AWS Lambda Limits
http://docs.aws.amazon.com/lambda/latest/dg/limits.html
Supported Language Versions
http://docs.aws.amazon.com/lambda/latest/dg/current-supported-
versions.html
Contact
Email: hello@itsmemattchung.com
GitHub / Twitter : @itsmemattchung

More Related Content

What's hot (20)

PPTX
Cloudsolutionday 2016: Getting Started with Severless Architecture
AWS Vietnam Community
 
PPTX
Meetup #3: Migrating an Oracle Application from on-premise to AWS
AWS Vietnam Community
 
PPTX
Greetings from AWS User Group Taiwan
Cliff Chao-kuan Lu
 
PPTX
104 meets cloud
Cliff Chao-kuan Lu
 
PDF
NetflixOSS and ZeroToDocker Talk
aspyker
 
PDF
Netflix and Containers: Not A Stranger Thing
aspyker
 
PDF
Intro to Serverless
Cliff Chao-kuan Lu
 
PPTX
Reliable, Scalable Kubernetes on AWS
Applatix
 
PPTX
Kubernetes + netflix oss
Cristiano Altmann
 
PDF
CS80A Foothill College Open Source Talk
aspyker
 
PDF
Serverless Logging Architecture
Narendran R
 
PPTX
Operationnal challenges behind Serverless architectures by Laurent Bernaille
The Incredible Automation Day
 
PDF
AWS re:Invent 2016 Fast Forward
Shuen-Huei Guan
 
PDF
Triangle Devops Meetup 10/2015
aspyker
 
PPTX
Sas 2015 event_driven
Sascha Möllering
 
PPTX
Scalable and reliable kubernetes on aws
Applatix
 
PDF
Iot meets Serverless
Narendran R
 
PDF
Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...
HostedbyConfluent
 
PPTX
Serverless Patterns
Cliff Chao-kuan Lu
 
PPTX
Serverless Reality
Lynn Langit
 
Cloudsolutionday 2016: Getting Started with Severless Architecture
AWS Vietnam Community
 
Meetup #3: Migrating an Oracle Application from on-premise to AWS
AWS Vietnam Community
 
Greetings from AWS User Group Taiwan
Cliff Chao-kuan Lu
 
104 meets cloud
Cliff Chao-kuan Lu
 
NetflixOSS and ZeroToDocker Talk
aspyker
 
Netflix and Containers: Not A Stranger Thing
aspyker
 
Intro to Serverless
Cliff Chao-kuan Lu
 
Reliable, Scalable Kubernetes on AWS
Applatix
 
Kubernetes + netflix oss
Cristiano Altmann
 
CS80A Foothill College Open Source Talk
aspyker
 
Serverless Logging Architecture
Narendran R
 
Operationnal challenges behind Serverless architectures by Laurent Bernaille
The Incredible Automation Day
 
AWS re:Invent 2016 Fast Forward
Shuen-Huei Guan
 
Triangle Devops Meetup 10/2015
aspyker
 
Sas 2015 event_driven
Sascha Möllering
 
Scalable and reliable kubernetes on aws
Applatix
 
Iot meets Serverless
Narendran R
 
Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...
HostedbyConfluent
 
Serverless Patterns
Cliff Chao-kuan Lu
 
Serverless Reality
Lynn Langit
 

Viewers also liked (20)

PPTX
Hybrid IT
Windows Azure
 
PPTX
Real World Azure - IT Pros
Clint Edmonson
 
PDF
Serverless architecture with AWS Lambda (June 2016)
Julien SIMON
 
PPTX
Microsoft Azure 概觀 (2014-4-2 雲端達人班)
Jeff Chu
 
PPTX
Windows Azure Security & Compliance
Nuno Godinho
 
PPTX
Benchmarking Aerospike on the Google Cloud - NoSQL Speed with Ease
Lynn Langit
 
PPTX
Windows Azure Security Features And Functionality
vivekbhat
 
PDF
Google Cloud Platform Introduction - 2016Q3
Simon Su
 
PDF
#DOXLON October 2016 - Mesos Deployment at Schibsted
Outlyer
 
PPTX
SQL Server on Google Cloud Platform
Lynn Langit
 
PDF
Neil Saunders (Beamly) - Securing your AWS Infrastructure with Hashicorp Vault
Outlyer
 
PPTX
Introduction to Azure Functions
Marco Parenzan
 
PPTX
MS Cloud Summit Paris 2017 - Azure Stack
Benoît SAUTIERE
 
PPTX
Aws vs. Azure: 5 Things You Need To Know
Scalr
 
PPTX
Azure Functions Real World Examples
Yochay Kiriaty
 
PPTX
Inside Logic Apps
BizTalk360
 
PPTX
Google Cloud and Data Pipeline Patterns
Lynn Langit
 
PDF
Modernizing Applications with Microservices and DC/OS (Lightbend/Mesosphere c...
Lightbend
 
PDF
Serverless Architecture
Lena Barinova
 
PPTX
Serverless Architecture - Azure Logic apps
Puneet Ghanshani
 
Hybrid IT
Windows Azure
 
Real World Azure - IT Pros
Clint Edmonson
 
Serverless architecture with AWS Lambda (June 2016)
Julien SIMON
 
Microsoft Azure 概觀 (2014-4-2 雲端達人班)
Jeff Chu
 
Windows Azure Security & Compliance
Nuno Godinho
 
Benchmarking Aerospike on the Google Cloud - NoSQL Speed with Ease
Lynn Langit
 
Windows Azure Security Features And Functionality
vivekbhat
 
Google Cloud Platform Introduction - 2016Q3
Simon Su
 
#DOXLON October 2016 - Mesos Deployment at Schibsted
Outlyer
 
SQL Server on Google Cloud Platform
Lynn Langit
 
Neil Saunders (Beamly) - Securing your AWS Infrastructure with Hashicorp Vault
Outlyer
 
Introduction to Azure Functions
Marco Parenzan
 
MS Cloud Summit Paris 2017 - Azure Stack
Benoît SAUTIERE
 
Aws vs. Azure: 5 Things You Need To Know
Scalr
 
Azure Functions Real World Examples
Yochay Kiriaty
 
Inside Logic Apps
BizTalk360
 
Google Cloud and Data Pipeline Patterns
Lynn Langit
 
Modernizing Applications with Microservices and DC/OS (Lightbend/Mesosphere c...
Lightbend
 
Serverless Architecture
Lena Barinova
 
Serverless Architecture - Azure Logic apps
Puneet Ghanshani
 
Ad

Similar to Matt Chung (Independent) - Serverless application with AWS Lambda (20)

PPTX
Fin jaws 202103
Yuki Yoshida
 
PDF
AWS re:Invent 2020 Serverless Recap
Daniel Zivkovic
 
PPTX
Developing serverless applications with .NET on AWS
Woody Pewitt
 
PDF
Symfony aws
Alessandro Minoccheri
 
PDF
Serverless Culture
AWS User Group Bengaluru
 
PPTX
Building serverless app_using_aws_lambda_b4usolution
Hoa Le
 
PDF
Cloud computing workshop at IIT bombay
Nilesh Satpute
 
PPTX
Containerize all the things!
Mike Melusky
 
PPTX
Journey Towards Scaling Your Application to Million Users
Adrian Hornsby
 
PDF
Building serverless apps with Node.js
Julien SIMON
 
PDF
A 60-mn tour of AWS compute (March 2016)
Julien SIMON
 
PDF
Serverless in Java Lessons learnt
Krzysztof Pawlowski
 
PDF
Continuous Deployment in AWS Lambda
Shu Ting Tseng
 
PDF
Intro To Serverless ClojureScript
Jim Lynch
 
PDF
How IT at Getty Images Brokers Cloud Services
RightScale
 
PPTX
Serverless Microservices - Real life story of a Web App that uses AngularJS, ...
Mitoc Group
 
PDF
An introduction to serverless architectures (February 2017)
Julien SIMON
 
PDF
AWS CDK를 활용한 클라우드 프로그래밍
Eunsu Kim
 
PPTX
Serverless Microservices - Real life story of a Web App that uses AWS Lambda
Mitoc Group
 
PDF
Application Lifecycle Management on AWS
David Mat
 
Fin jaws 202103
Yuki Yoshida
 
AWS re:Invent 2020 Serverless Recap
Daniel Zivkovic
 
Developing serverless applications with .NET on AWS
Woody Pewitt
 
Serverless Culture
AWS User Group Bengaluru
 
Building serverless app_using_aws_lambda_b4usolution
Hoa Le
 
Cloud computing workshop at IIT bombay
Nilesh Satpute
 
Containerize all the things!
Mike Melusky
 
Journey Towards Scaling Your Application to Million Users
Adrian Hornsby
 
Building serverless apps with Node.js
Julien SIMON
 
A 60-mn tour of AWS compute (March 2016)
Julien SIMON
 
Serverless in Java Lessons learnt
Krzysztof Pawlowski
 
Continuous Deployment in AWS Lambda
Shu Ting Tseng
 
Intro To Serverless ClojureScript
Jim Lynch
 
How IT at Getty Images Brokers Cloud Services
RightScale
 
Serverless Microservices - Real life story of a Web App that uses AngularJS, ...
Mitoc Group
 
An introduction to serverless architectures (February 2017)
Julien SIMON
 
AWS CDK를 활용한 클라우드 프로그래밍
Eunsu Kim
 
Serverless Microservices - Real life story of a Web App that uses AWS Lambda
Mitoc Group
 
Application Lifecycle Management on AWS
David Mat
 
Ad

More from Outlyer (20)

PPTX
Murat Karslioglu, VP Solutions @ OpenEBS - Containerized storage for containe...
Outlyer
 
PPTX
How & When to Feature Flag
Outlyer
 
PPTX
Why You Need to Stop Using "The" Staging Server
Outlyer
 
PPTX
How GitHub combined with CI empowers rapid product delivery at Credit Karma
Outlyer
 
PPTX
Packaging Services with Nix
Outlyer
 
PDF
Minimum Viable Docker: our journey towards orchestration
Outlyer
 
PDF
Ops is dead. long live ops.
Outlyer
 
PDF
The service mesh: resilient communication for microservice applications
Outlyer
 
PPTX
Microservices: Why We Did It (and should you?)
Outlyer
 
PPTX
Renan Dias: Using Alexa to deploy applications to Kubernetes
Outlyer
 
PDF
Alex Dias: how to build a docker monitoring solution
Outlyer
 
PPTX
How to build a container monitoring solution - David Gildeh, CEO and Co-Found...
Outlyer
 
PDF
Heresy in the church of - Corey Quinn, Principal at The Quinn Advisory Group
Outlyer
 
PDF
Anatomy of a real-life incident -Alex Solomon, CTO and Co-Founder of PagerDuty
Outlyer
 
PDF
A Holistic View of Operational Capabilities—Roy Rapoport, Insight Engineering...
Outlyer
 
PPTX
The Network Knows—Avi Freedman, CEO & Co-Founder of Kentik
Outlyer
 
PPTX
Building a production-ready, fully-scalable Docker Swarm using Terraform & Pa...
Outlyer
 
PDF
Zero Downtime Postgres Upgrades
Outlyer
 
PDF
DOXLON November 2016: Facebook Engineering on cgroupv2
Outlyer
 
PDF
DOXLON November 2016 - ELK Stack and Beats
Outlyer
 
Murat Karslioglu, VP Solutions @ OpenEBS - Containerized storage for containe...
Outlyer
 
How & When to Feature Flag
Outlyer
 
Why You Need to Stop Using "The" Staging Server
Outlyer
 
How GitHub combined with CI empowers rapid product delivery at Credit Karma
Outlyer
 
Packaging Services with Nix
Outlyer
 
Minimum Viable Docker: our journey towards orchestration
Outlyer
 
Ops is dead. long live ops.
Outlyer
 
The service mesh: resilient communication for microservice applications
Outlyer
 
Microservices: Why We Did It (and should you?)
Outlyer
 
Renan Dias: Using Alexa to deploy applications to Kubernetes
Outlyer
 
Alex Dias: how to build a docker monitoring solution
Outlyer
 
How to build a container monitoring solution - David Gildeh, CEO and Co-Found...
Outlyer
 
Heresy in the church of - Corey Quinn, Principal at The Quinn Advisory Group
Outlyer
 
Anatomy of a real-life incident -Alex Solomon, CTO and Co-Founder of PagerDuty
Outlyer
 
A Holistic View of Operational Capabilities—Roy Rapoport, Insight Engineering...
Outlyer
 
The Network Knows—Avi Freedman, CEO & Co-Founder of Kentik
Outlyer
 
Building a production-ready, fully-scalable Docker Swarm using Terraform & Pa...
Outlyer
 
Zero Downtime Postgres Upgrades
Outlyer
 
DOXLON November 2016: Facebook Engineering on cgroupv2
Outlyer
 
DOXLON November 2016 - ELK Stack and Beats
Outlyer
 

Recently uploaded (20)

PPTX
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
PDF
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
PDF
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
PDF
Exolore The Essential AI Tools in 2025.pdf
Srinivasan M
 
PPTX
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
PDF
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
PDF
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PDF
IoT-Powered Industrial Transformation – Smart Manufacturing to Connected Heal...
Rejig Digital
 
PDF
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
PPTX
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PPTX
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
PDF
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
PPTX
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
PDF
Staying Human in a Machine- Accelerated World
Catalin Jora
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
Advancing WebDriver BiDi support in WebKit
Igalia
 
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
Exolore The Essential AI Tools in 2025.pdf
Srinivasan M
 
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
IoT-Powered Industrial Transformation – Smart Manufacturing to Connected Heal...
Rejig Digital
 
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
CIFDAQ Token Spotlight for 9th July 2025
CIFDAQ
 
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
Staying Human in a Machine- Accelerated World
Catalin Jora
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
Advancing WebDriver BiDi support in WebKit
Igalia
 

Matt Chung (Independent) - Serverless application with AWS Lambda

  • 1. Serverless Architecture with AWS lambda @itsmemattchung
  • 2. Agenda • Brief background about me • Use Case / Problem • Live Demo • Lessons Learned
  • 3. About Me Roots in systems and networking. Primary focus is software development • Engineer @ Cisco Systems • Director.Technical Operations @ Fox Networks (NewsCorp / 21st Century Fox) • Python / DevOps @ Whalerock Industries
  • 4. What problem are we trying to solve? • Scheduled tasks • Existing solutions • Cron • Celery beat • RQ
  • 5. What is AWS Lambda "... a compute service where you can upload your code to AWS Lambda and the service can run the code on your behalf using AWS infrastructure."1 -- AWS Developer Guide 1 https://forums.aws.amazon.com/message.jspa?messageID=619362
  • 6. Attending AWS re:Invent 2015 • Python / Django shop - Celery Beat with single instance scheduler • Lambda as Cron: Scheduling Invocations in AWS Lambda • Using CloudWatch to trigger alarm • SNS topic to trigger AWS Lambda There's got to be an EASIER way
  • 8. A few Core Principles • Pre-production (i.e "DEV", "QA") and production environments • Application logging • Monitoring / Notifications • Easy to deploy
  • 9. Live Demo • Trigger web performance tests on a scheduled basis using SpeedCurve API. Sample application • Build • Deploy • Execute
  • 10. How to separate environments Each function is its own "environment" • DeploySpeedCurve-dev • DeploySpeedCurve-staging • DeploySpeedCurve-production
  • 11. Use Case: Log Ingestion service • Akamai Netstorage • AWS Lambda • SumoLogic
  • 12. Things I wished I knew before • Language support • Limitations
  • 13. Example code var path = require('path'); path.parse(logfileToUpload) .... TypeError: Object #<Object> has no method 'parse' Worked locally, but NOT on AWS Lambda
  • 14. Supported Languages • Node.js: v0.10.36 • Java: Java 8 • Python: Python 2.7
  • 16. How to separate environments Environment Variables
  • 17. How to separate environment variables (part 2) • Download .env-$ENVIRONMENT from S3 • Invoke Build Process
  • 18. How much did we spend the last month?
  • 19. Key Takeaways • Treat file system as ephemeral • What language version are you running?
  • 20. Resources How to create a deployment package http://docs.aws.amazon.com/lambda/latest/dg/lambda-python-how- to-create-deployment-package.html AWS Lambda Limits http://docs.aws.amazon.com/lambda/latest/dg/limits.html Supported Language Versions http://docs.aws.amazon.com/lambda/latest/dg/current-supported- versions.html
  • 21. Contact Email: [email protected] GitHub / Twitter : @itsmemattchung