Serverless 2019 and Beyond

Serverless 2019 and Beyond

• 1.
  Serverless 2019 andBeyond Mark R. Hinkle Co-founder, TriggerMesh @mrhinkle
• 2.
  TriggerMesh – MulticloudServerless Management Platform Mark Hinkle, co-founder TriggerMesh • Executive Director, Node.js • VP of Marketing, Linux Foundation • Head of Citrix Open Source Office • VP, Cloud.com (acquired by Citrix) • VP, Zenoss (drove revenue from $400k to $20 mil) • Director Tech Support, MindSpring (ran a $90 million BU) • Governing Boards -, Xen Project, Apache CloudStack • Editor-in-Chief - Linuxworld, Magazine, Enterprise Open Source Magazine Twitter: @mrhinkle Email: [email protected]
• 3.
  Serverless today
• 4.
  TriggerMesh – MulticloudServerless Management Platform Busted Old Joint, New Hotness Monolithic Applications Cloud-native Applications
• 5.
  TriggerMesh – MulticloudServerless Management Platform Monolithic architecture Data Access ServiceServiceService Model View ControllerJavaScriptHTML Relational Database
• 6.
  TriggerMesh – MulticloudServerless Management Platform Cloud-native architecture Cloud Native Application User authentication Via Oauth, Identity and Access Management (IAM) Static content suchs as HTML, JavaScript, CSS from web servers and/or cloud object storage. Serverless functions running compute on serverless clouds (e.g. Lambda, GCF, ACF) or on- premise FaaS. API Gateway Database(s) - Cloud-based NoSQL, SQL or on-premise
• 7.
  Serverless is thefuture (sort of)
• 8.
  TriggerMesh – MulticloudServerless Management Platform Continuous integration, continuous deployment is going to change and that’s where things like microservices, containers are playing a massive role in the outer loop, but one of the things that I think is going to completely change how we think about logic is serverless. Serverless computation will fundamentally, not only change the economics of what is backing computing, but it’s going to be the core of the future of distributed computing. So this application paradigm shift of intelligent cloud and intelligent edge is going to be pervasively changing everything we do inside of Windows, inside of Office 365, inside of Azure and the rest of what you will hear about in the next three days is about unpacking this. Satya Nadella Keynote - Microsoft Build 2017 conference
• 9.
  TriggerMesh – MulticloudServerless Management Platform The torrid pace of adoption and innovation in the serverless (Lambda) space has totally blown us away, In particular, Lambda, AWS’s main serverless service, has “grown like crazy,” with hundreds of thousands of active customers using it in the last 30 days. That’s 300%-plus year-over-year growth. “When we launched Lambda, the first serverless compute service, it was a watershed moment,” ...large generations of customers will skip instances and containers and go right to serverless -- in fact, if Amazon.com were starting today, it would go serverless. Andy Jassy Amazon Web Services Inc. Chief Executive Re:Invent 2017
• 10.
  Modern architecture isserverless
• 11.
  TriggerMesh – MulticloudServerless Management Platform What is serverless? ● Abstraction of backend infrastructure completely ● Execution environment for single purpose functions ● Hosted in public cloud or on-premise ● Serverless functions have a runtime in a stateless container ○ E.g. Node.js, JavaScript, Go, Python, Java ● Event-driven startup triggers/instant scale out or in. ● Micro-billing instead of per-hour/month billing.
• 12.
  TriggerMesh – MulticloudServerless Management Platform Function-as-a-service (FaaS) ● FaaS delivers serverless computing ● Abstraction of backend infrastructure ● “Typically” leveraging Kubernetes
• 13.
  TriggerMesh – MulticloudServerless Management Platform Open source FaaS software • Firecracker (Amazon) • Fission (Platform 9) • Fn (Oracle) • Knative/Kubernetes (Google) • Kubeless (VMware) • OpenFaaS • OpenWhisk (IBM) • Serverless (Serverless Inc.)
• 14.
  TriggerMesh – MulticloudServerless Management Platform Backend-as-a-service (BaaS) BaaS or Backend-as-a-Service refers to the infrastructure components managed by a cloud provider. Examples of BaaS: • AWS S3 • AWS DynamoDB • Azure Kubernetes Service (AKS) • Google BigQuery
• 15.
  TriggerMesh – MulticloudServerless Management Platform Simple serverless function Mobile phone takes picture and uploads it to object storage in the cloud. Various side photos are uploaded to an S3 bucket on AWS Resize images to thumbnails in a photo sharing service S3 Event triggers an Amazon Lambda function. Amazon Lambda function resizes image. Thumbnails are written to another S3 bucket on AWS. Thumbnails are server to a mobile application from a webserver and s3.
• 16.
  TriggerMesh – MulticloudServerless Management Platform Microservices ● Single purposes functions that deliver accomplish a single task ● Can run on a server, container or in a serverless infrastructure ● Microservices are typically combined to deliver a cloud native application via presentation layer Example of Microservices in a Storefront Application Inventory DBMobile Application Browser API Gateway Storefront App Inventory Service Account DBAccount Service Shipping DB Shipping Service
• 17.
  TriggerMesh – MulticloudServerless Management Platform Event-driven architecture (EDA) ● Design pattern around the production and reaction to events ● Serverless functions are triggered by events ● Examples events: ○ A file uploaded to an S3 bucket ○ Inserts on a DynamoDB table ○ A message published to an SNS/PubSub topic ○ A CloudWatch alert
• 18.
  TriggerMesh – MulticloudServerless Management Platform Cloud-native application Mobile phone takes picture and uploads it to object storage in the cloud. Various side photos are uploaded to an S3 bucket on AWS Photo sharing service Thumbnails are written to and served from object storage on AWS S3 Thumbnails are server to a mobile application from a webserver and s3. User plan supporting quotas is queryable via Salesforce Alerts users in a network that new images from their friends are available. Photos are shared among a social network of users. Amazon Lambda function resizes an image every time a new
• 19.
  Where serverless isa good idea
• 20.
  TriggerMesh – MulticloudServerless Management Platform Criteria for using serverless ● Asynchronous, concurrent ● Infrequent or has sporadic demand ● Stateless, ephemeral ● Highly dynamic in terms of changing business requirements Source: CNCF Serverless Whitepaper v1.0
• 21.
  TriggerMesh – MulticloudServerless Management Platform Examples of serverless use cases • Multimedia processing • Database changes or change data capture • IoT sensor input messages • Stream processing at scale • Chat bots • Batch jobs scheduled tasks • HTTP REST APIs and web apps • Mobile back ends • Business logic • Continuous integration pipeline Source: CNCF Serverless Whitepaper v1.0
• 22.
  TriggerMesh – MulticloudServerless Management Platform Serverless benefits • Reduced cost • Risk mitigation • Increased flexibility of scaling • Shorter lead time
• 23.
  Where serverless breaksdown
• 24.
  TriggerMesh – MulticloudServerless Management Platform Serverless gotchas • Portability • Automation / DevOps • Cross-Cloud Communication
• 25.
  TriggerMesh – MulticloudServerless Management Platform The cold start problem ● Applications that haven't been used recently take longer to startup and to handle the first request. ● Because serverless happens on use, there aren’t dedicated instances ready to handle requests ● Solution: Run a function in a dedicated container/VM, not serverless
• 26.
  TriggerMesh – MulticloudServerless Management Platform Security risks • Function Event-Data Injection • Broken Authentication • Insecure Serverless Deployment Configuration • Overprivileged Function Permissions and Roles • Inadequate Function Monitoring and Logging • Insecure Third-Party Dependencies • Insecure Application Secrets Storage • Denial-of-Service and Financial Resource Exhaustion • Serverless Business Logic Manipulation • Improper Exception Handling and Verbose Error Messages • Legacy/Unused Functions & Cloud Resources • Cross-Execution Data Persistency Source : CSA - The 12 Most Critical Risks for Serverless Applications 2019
• 27.
  Considerations for theenterprise
• 28.
  Cloud Silos
• 29.
  Enterprise Eventing
• 30.
  Serverless skills gap
• 31.
  Monitoring vs. observability
• 32.
  Stateful versus stateless
• 33.
  Forecasting costs
• 34.
  TRIGGERMESH PROVIDES APLATFORM TO MANAGE THE WHOLE SERVERLESS PRODUCT LIFECYCLE VIA A HOSTED PLATFORM. HTTP://CLOUD.TRIGGERMESH.IO - Last Updated - 2/5/19
• 35.
  TriggerMesh – MulticloudServerless Management Platform Where serverless falls short Source: The New Stack Serverless Survey 2018 Q: What are the top three areas in which serverless falls short of expectations? n=251 https://thenewstack.io/ebooks/serverless/guide-to-serverless-technologies/ According to the New Stack’s 2018 Serverless Survey these are the places where serverless falls short. TriggerMesh can help provide solutions to all of these problems especially the top problems of portability, control, and risk reduction by providing a full serverless lifecycle management solution that is consistent with DevOps culture and best practices.
• 36.
  TriggerMesh – MulticloudServerless Management Platform TriggerMesh architecture
• 37.
  TriggerMesh – MulticloudServerless Management Platform TriggerMesh product features • Software-as-a-Service cloud.triggermesh.io • Source Control Integration Github/Gitlab/Bitbucket • Deployment Kubernete/Knative, Amazon Lambda, Microsoft Azure, Google Cloud Functions • Cross Cloud Event Bus Compatible with all clouds. Today there is no cross- cloud serverless event bus. • Function Store Allow users to share function to build a community hub for collaboration • Serverless Framework Integration Utilizes serverless deployment manifest in the repos containing the function to deploy in a versatile manner • Kubernetes Builds for Versioning Using Google’s Knative platform, use the Build extension to provide immutable and reproducible builds of functions images. • Cost Optimization Via observability (open tracing in Istio), monitor time spent in functions and render cost budget per function • Monitoring Time-series monitoring via Prometheus, defacto standard in cloud monitoring
• 38.
  TriggerMesh – MulticloudServerless Management Platform Enhanced serverless hosting During our Beta Period we are offering free serverless hosting with access to all our product features. To sign-up for free visit: http://cloud.triggermesh.io
• 39.
  Web - www.triggermesh.com Twitter- @twittermesh Email – [email protected] Mark Hinkle [email protected] 919.522.3520 Sebastien Goasguen [email protected] +41 79 367 3825