Pydata 2020 containers meetup

Pydata 2020 containers meetup

• 1.
  @walidshaari [email protected] https://www.linkedin.com/in/walidshaari/ Containers
• 2.
  DOCKER HISTORY ▪ Startedas internal project @ dotcloud ▪ Open Sourced in 2013 ▪ Developed in the open ▪ Quiz: Pay Attention to commands Solomon Hykes run http://www.taos.com/from-dotcloud-to-docker/
• 3.
  Docker exercise I Runyour first container using two container runtimes http://bit.ly/pydata01 - docker - podman Objective - Learn and Be Curious - Core containers operations from Solomon Hykes lighting talk - run - images - history - search ??
• 4.
  https://www.docker.com/blog/introducing-the-docker-index/
• 7.
  Why use containers?
• 8.
  Docker exercise II Buildyour first container http://bit.ly/pydata02 Objective - How to containerize if you can not find what you want available? - Prototyping a coding project - Customizing - What else? 1- git clone https://github.com/jakewright/tutorials
• 10.
  6- cd product 7-docker build -t product-service . 8- docker run -p 5001:80 --rm -d product-service 9- docker ps 10- curl localhost:5001 11- docker images
• 11.
  build, tag, push,pull, build, tag, ....
• 12.
  Cache .. tag:latest
• 13.
  Push… Pull
• 14.
  • Standardized packagingfor software and dependencies • Isolate apps from each other • Share the same OS kernel • Works for all major Linux distributions • Containers are mostly Linux, however there is native Windows containers too. Recap: What are Docker containers?
• 15.
  Containers are anapp level construct VMs are an infrastructure level construct to turn one machine into many servers Comparing VMs and Containers Infrastructure Libs App A App B App C App D Traditional Bare Metal servers
• 16.
  Containers and VMstogether Containers and VMs together provide a tremendous amount of flexibility for IT to optimally deploy and manage apps.
• 18.
  Thank the giants
• 19.
  What are containers? Containersare processes born from tarballs anchored to namespaces controlled by cgroups Alice Goldfuss - The Container Operator’s Manual
• 20.
  Docker Compose
• 21.
  https://azure.microsoft.com/en-us/resources/kubernetes-learning-path/
• 22.
  Project Overview
• 23.
  What Does “Kubernetes”Mean? Greek for “pilot” or “Helmsman of a ship” Image Source
• 24.
  What is Kubernetes? ●Project that was spun out of Google as an open source container orchestration platform. ● Built from the lessons learned in the experiences of developing and running Google’s Borg and Omega. ● Designed from the ground-up as a loosely coupled collection of components centered around deploying, maintaining and scaling workloads.
• 25.
  25
• 26.
  What Does Kubernetesdo? ● Known as the linux kernel of distributed systems. ● Abstracts away the underlying hardware of the nodes and provides a uniform interface for workloads to be both deployed and consume the shared pool of resources. ● Works as an engine for resolving state by converging actual and the desired state of the system.
• 28.
  Decouples Infrastructure andScaling ● All services within Kubernetes are natively Load Balanced. ● Can scale up and down dynamically. ● Used both to enable self-healing and seamless upgrading or rollback of applications.
• 29.
  Self Healing Kubernetes willALWAYS try and steer the cluster to its desired state. ● Me: “I want 3 healthy instances of redis to always be running.” ● Kubernetes: “Okay, I’ll ensure there are always 3 instances up and running.” ● Kubernetes: “Oh look, one has died. I’m going to attempt to spin up a new one.”
• 30.
  What can KubernetesREALLY do? ● Autoscale Workloads ● Blue/Green Deployments ● Fire off jobs and scheduled cronjobs ● Manage Stateless and Stateful Applications ● Provide native methods of service discovery ● Easily integrate and support 3rd party apps
• 31.
  Most Importantly... Use theSAME API across bare metal and EVERY cloud provider!!!
• 32.
  Who “Manages” Kubernetes? TheCNCF is a child entity of the Linux Foundation and operates as a vendor neutral governance group.
• 33.
  Project Stats ● Over55,000 stars on Github ● 2000+ Contributors to K8s Core ● Most discussed Repository by a large margin ● 70,000+ users in Slack Team 07/2019
• 34.
  Project Stats
• 35.
  A Couple Key Concepts...
• 36.
  Pods ● Atomic unitor smallest “unit of work”of Kubernetes. ● Pods are one or MORE containers that share volumes, a network namespace, and are a part of a single context.
• 37.
  Pods They are also Ephemeral!
• 38.
  Services ● Unified methodof accessing the exposed workloads of Pods. ● Durable resource ○ static cluster IP ○ static namespaced DNS name
• 39.
  Services ● Unified methodof accessing the exposed workloads of Pods. ● Durable resource ○ static cluster IP ○ static namespaced DNS name NOT Ephemeral!
• 40.
  Architecture Overview
• 42.
  Kubernetes’ High-Level ArchitectureOverview Source: https://www.weave.works/blog/what-does-production-ready-really-mean-for-a-kubernetes-cluster
• 43.
  Kubernetes’ High-Level ArchitectureOverview
• 44.
  Portability through Abstraction
• 45.
  Application dependency onKubernetes primitives Source: Kubernetes effect by Bilgin Ibryam
• 46.
  Kubernetes Architecture 101 Source:https://www.aquasec.com/wiki/display/containers/Kubernetes+Architecture+101
• 47.
  Create a twoworker node kind k8s cluster kind create cluster --name pydate --config .kind.yaml
• 48.
  Deployment, ReplicaSet, Pod, andService kind create cluster --name pydate --config .kind.yaml http://bit.ly/pydata-wildwest https://training.play-with-kubernetes.com/
• 49.
  Application dependency onKubernetes primitives Source: Kubernetes effect by Bilgin Ibryam
• 50.
  50 Thank you