ECS を利用したデプロイ環境

Transcript

1. &$4
   Λར༻ͨ͠σϓϩΠ؀ڥ ,PIFJ
   4V[VLJ

2. .F • @eagletmt • ΫοΫύου ٕज़෦։ൃج൫άϧʔϓ • Docker Λར༻ͨ͠ΞϓϦέʔγϣϯαʔόج൫ͷ ։ൃɺӡ༻

3. Ξ΢τϥΠϯ • ΫοΫύουͱ Docker • Docker ΞϓϦͷσϓϩΠํ๏ v1 • ECS

   ҎલͷσϓϩΠํ๏ • Docker ΞϓϦͷσϓϩΠํ๏ v2 • ECS Λར༻ͨ͠σϓϩΠπʔϧ Hako ͷ։ൃ • Hako Λ࢖ͬͨσϓϩΠ؀ڥ

4. ΫοΫύουͱ
   %PDLFS • 2014೥9݄ࠒ͔Β Docker ͷར༻Λݕ౼ • ࣗ෼͕৽نʹ։ൃ͢Δখ͍͞ Web API ΞϓϦέʔ

   γϣϯΛύΠϩοτϓϩδΣΫτͱ͠ɺ12݄͔Βར ༻։࢝

5. ΫοΫύουͱ
   %PDLFS • 2015೥͔Βɺ৽نͷ Web ΞϓϦέʔγϣϯ͸جຊ తʹ Docker Λར༻ͨ͠؀ڥ (v1) Ͱಈ࡞

   • 2016೥6݄ݱ࣌఺ʹ͓͍ͯɺ • ຊ൪Քಈ͍ͯ͠ΔαʔϏε͕ 11 ݸ • εςʔδϯά༻్ʹ 14 ݸ • ࣾ಺αʔϏεʹ 8 ݸ

6. ΫοΫύουͱ
   %PDLFS • 2015೥9݄ࠒ͔Β ECS Λར༻ͨ͠৽ߏ੒ (v2) Λݕ౼ • 2016೥1݄͔Βࣾ಺αʔϏεͰར༻։࢝ •

   5݄͔Βຊ൪Ͱ΋ར༻։࢝͠ɺݱ࣌఺Ͱ • ຊ൪Քಈ͍ͯ͠ΔαʔϏε͕ 2 ݸ • εςʔδϯά༻్ʹ 10 ݸ • ࣾ಺αʔϏεʹ 21 ݸ

7. %PDLFS
   ΞϓϦͷσϓϩΠ ํ๏
   W

8. &$4
   Λ࢖͍࢝ΊΔલ • σϓϩΠํ๏Λߟ͑ɺϗετଆʹσϓϩΠεΫϦϓτ Λ༻ҙ͢Δ͜ͱʹͨ͠ • ඞཁͳ͜ͱ • Web ΞϓϦέʔγϣϯͷσϓϩΠΛແఀࢭͰߦ͏ •

   σϓϩΠ͸શ։ൃऀ͕ߦ͏͜ͱ͕Ͱ͖Δ • ։ൃऀʹ͸ൿಗ஋ (DB ύεϫʔυͳͲ) Λݟͤͳ͍ • ൿಗ஋͸؀ڥม਺ͱͯ͠౉͢

9. σϓϩΠํ๏
   W • 1ͭͷϗετʹ1ͭ·ͨ͸ෳ਺ͷ Docker ίϯςφ • ϗετଆʹ nginx Λ1ͭىಈ͠ɺHost

   ϔομͰίϯςφ ʹৼΓ෼͚ • σϓϩΠ࣌͸ɺίϯςφΛ৽نʹىಈ͠ɺnginx ͷઃఆ Λมߋͯ͠Ϧϩʔυ͠ɺݹ͍ίϯςφΛఀࢭ͢Δ • ৄ͘͠͸ http://techlife.cookpad.com/entry/ 2015/04/20/134758

10. σϓϩΠํ๏
    W OHJOY BQQ
    TFSWFS DPOUBJOFS
    W EFQMPZ
    TDSJQU

11. σϓϩΠํ๏
    W OHJOY BQQ
    TFSWFS DPOUBJOFS
    W DPOUBJOFS
    W EFQMPZ
    TDSJQU docker

    run

12. σϓϩΠํ๏
    W OHJOY BQQ
    TFSWFS DPOUBJOFS
    W DPOUBJOFS
    W EFQMPZ
    TDSJQU IFBMUI
    DIFDL

13. σϓϩΠํ๏
    W OHJOY BQQ
    TFSWFS DPOUBJOFS
    W DPOUBJOFS
    W EFQMPZ
    TDSJQU nginx

    -s reload

14. σϓϩΠํ๏
    W OHJOY BQQ
    TFSWFS DPOUBJOFS
    W EFQMPZ
    TDSJQU docker stop

15. W
    ͷΑ͔ͬͨ఺ • Πϯϑϥ͕ Itamae ͰΞϓϦέʔγϣϯຖʹϓϩϏ δϣχϯά͢Δख͕ؒͳ͘ͳͬͨ • ڞ௨ͷϗετͷ্ʹ༷ʑͳίϯςφ͕ಈ͘ • ΞϓϦέʔγϣϯαʔόͷΦʔτεέʔϧ͕͠΍͢

    ͘ͳͬͨ • શ͘ಉ͡ํ๏ͰɺͲΜͳΞϓϦέʔγϣϯ΋εέʔ ϧΠϯɾεέʔϧΞ΢τͰ͖Δ

16. W
    ͷ࢒೦ͩͬͨ఺ • σϓϩΠઌͷϗετͷࢦఆ͕ਓྗ • EC2 λάʹࢦఆ͍ͯͨ͠ • ৽نͷαʔϏεΛ௥Ճ͢Δͱ͖͸ɺۭ͍ͯͦ͏ͳΠϯε λϯεʹλάΛ͚ͭΔ͔ɺ৽نʹىಈ͢Δඞཁ͕͋ͬͨ •

    ΞϓϦέʔγϣϯαʔόҎ֎ʹ΋ඞཁͳ΋ͷ͸͋Δ • RDSɺRoute53ɺELBɺCapistrano ͷઃఆ • ؀ڥม਺ͷ௥Ճ

17. %PDLFS
    ΞϓϦͷσϓϩΠ ํ๏
    W

18. &$4
    Խ • ECS Λར༻͢Δ͜ͱͰɺσϓϩΠઌͷ੍ޚΛ೚ͤ Δ͜ͱ͕Ͱ͖Δ • EC2 λά͔Βͷղ์ • ECS

    Խʹ͋ͨͬͯൿಗ஋ͷѻ͍Λߟ͑Δ • task definition ͸Ӆͭͭ͠ɺผͷετϨʔδ͔Β ൿಗ஋Λ஫ೖ͢Δඞཁ͕͋Δ

19. &$4
    Խ • Route53 ΍ͦͷଞͷઃఆ͸ ECS ͚ͩͰ͸׬݁͠ͳ ͍ • ECS Λར༻ͭͭ͠ɺൿಗ஋ͷ஫ೖ΍ؔ࿈͢ΔϦιʔ

    ε΍ઃఆΛૢ࡞͢ΔσϓϩΠπʔϧ͕ඞཁ • => Hako ͷ։ൃ

20. )BLP • Docker ίϯςφΛσϓϩΠ͢ΔͨΊͷπʔϧ • ࠓͷͱ͜Ζ ECS ͷΈʹରԠ • ΞϓϦέʔγϣϯͷఆٛΛ

    YAML Ͱهड़ • ൿಗ஋ΛؚΉ؀ڥม਺Λѻ͑Δ • σϓϩΠ࣌ʹ༷ʑͳॲཧΛࠩ͠ࠐΉ͜ͱ͕Ͱ͖Δ

21. ઃܭϙϦγʔ • Ͱ͖Δ͚ͩ੩తͳఆٛʹ͢Δ • ఆٛ (ઃఆ) ͸ YAML Ͱɺίʔυ͸ Ruby

    Ͱ • ఆٛ͸ͦͷ··ͰɺRuby Ҏ֎Ͱ΋࣮૷Ͱ͖Δܗ • ϓϥΨϒϧʹ͢Δ • Docker ʹඞཁͳ΋ͷͷΈίΞʹؚΊΔ • ͦΕҎ֎ͷίʔυ͸ϓϥάΠϯͱͯࠩ͠͠ସ͑Մೳʹ ͢Δ

22. ΞϓϦέʔγϣϯఆٛ scheduler: <<: !include schedulers/internal_default.yml desired_count: 1 app: image: 01234567890.dkr.ecr.us-east-1.amazonaws.com/camo

    cpu: 128 memory: 128 port: 8080 env: $providers: - <<: !include env_providers/etcenv.yml root: /envs/hako/camo CAMO_KEY: '#{CAMO_KEY}' CAMO_KEEP_ALIVE: 'true' additional_containers: front: !include containers/front.yml consul-register: !include containers/consul_register_internal.yml scripts: - type: jenkins_tag job: docker-camo - !include scripts/route53_subdomain_shared.yml - !include scripts/nginx_omniauth.yml - type: consul_register

23. σϓϩΠํ๏
    W • Hako::Schedulers::Ecs • ECS ্ʹ serviceɺtask definitionɺELB Λ࡞੒

    • σϓϩΠ࣌ʹ͸ɺtask definition ͱ service Λߋ৽ • ͓ͦΒ͘ ECS ͷී௨ͷ࢖͍ํ

24. σϓϩΠํ๏
    W • YAML ͷఆٛͱ DescribeTaskDefinition ͷ݁ՌΛൺ ֱ • ඞཁʹԠͯ͡

    RegisterTaskDefinition Ͱߋ৽ • CreateService / UpdateService Ͱࢦ͍ͯ͠Δ task definition Λߋ৽ • CreateService ࣌ʹ͸ ELB ΋࡞੒͢Δ

25. σϓϩΠํ๏
    W &-# UBTL
    W TFSWJDF IBLP

26. σϓϩΠํ๏
    W &-# UBTL
    W UBTL
    W TFSWJDF IBLP 3FHJTUFS5BTL%FpOJUJPO
    6QEBUF4FSWJDF

27. σϓϩΠํ๏
    W &-# UBTL
    W TFSWJDF IBLP

28. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ • ͜ͷํ๏ͩͱ service ຖʹ ELB ͕ඞཁ •

    ࣾ಺޲͚ͷࡶαʔϏεͰ΋ຖճ ELB Λ࡞Δ…? • ڞ௨ͷ ELB Λ࢖͍ͭͭɺϦόʔεϓϩΩγͷઃఆΛ ͍͍͔Μ͡ʹมߋ͢ΔΑ͏ͳผͷϞʔυΛ࣮૷ • ࣾ಺ͷผͷج൫ʹґଘ͍ͯ͠ΔͷͰίʔυ͸ඇެ։ • Hako ͳΒσϓϩΠ෦෼͚ͩࠩ͠ସ͑Δ͜ͱ͕Մೳ

29. શମߏ੒
    W
    
    ࣾ಺αʔϏε൛ OHJOY &-# UBTL UBTL UBTL UBTL SFWFSTF
    QSPYZ

    DPOUBJOFS
    JOTUBODFT

30. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ OHJOY UBTL
    W DPOTVM IBLP TFSWJDF
    W

31. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ OHJOY UBTL
    W DPOTVM IBLP TFSWJDF
    W UBTL
    W TFSWJDF
    W

    3FHJTUFS5BTL%FpOJUJPO
    $SFBUF4FSWJDF

32. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ OHJOY UBTL
    W DPOTVM IBLP TFSWJDF
    W UBTL
    W TFSWJDF
    W

    SFHJTUFS

33. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ OHJOY UBTL
    W DPOTVM IBLP TFSWJDF
    W UBTL
    W TFSWJDF
    W

    DPOTVMUFNQMBUF
    nginx -s reload

34. σϓϩΠํ๏
    W
    
    ࣾ಺αʔϏε൛ OHJOY DPOTVM IBLP UBTL
    W TFSWJDF
    W %FMFUF4FSWJDF EFSFHJTUFS

    DPOTVMUFNQMBUF
    nginx -s reload

35. ൿಗ஋ͷѻ͍ • ؀ڥม਺ʹม਺ͷΑ͏ʹຒΊࠐΉ͜ͱ͕Ͱ͖Δ • DATABASE_URL: 'mysql2://#{user}:#{pass}@db- nanika-001/nanika' • ม਺͸σϓϩΠ࣌ʹผͷετϨʔδ͔Βऔಘ •

    ͨͱ͑͹ etcenv Λ࢖͏৔߹ • https://github.com/eagletmt/hako-etcenv • user ͷ৔ॴʹ /hako/nanika/user ͷ஋͕ೖΔ

36. )BLP
    Λ࢖ͬͨ
    σϓϩΠ؀ڥ

37. )BLP
    Λ࢖ͬͨσϓϩΠ؀ڥ • ΞϓϦέʔγϣϯఆ͚ٛͩΛؚΉϦϙδτϦ hako_apps Λ༻ҙ • ؀ڥม਺ͳͲΛมߋ͍ͨ͠ͱ͖͸ɺ։ൃऀ͕ࣗ༝ʹ pull-requestɺmerge • ൿಗ஋Λ௥Ճ͍ͨ͠ͱ͖ͷΈΠϯϑϥʹґཔ

38. )BLP
    Λ࢖ͬͨσϓϩΠ؀ڥ • σϓϩΠίϚϯυͷ࣮ߦʹ͸ Rundeck Λར༻ • app αʔόͰ࣮ߦ͢ΔίϚϯυ͕ແ͍ͷͰɺ Capistrano Λ࢖͏ඞཁ͕ͳ͍

    • Rundeck ্ͰδϣϒΛ࣮ߦ͢Δͱɺ • git clone git@repository:hako_apps.git • cd hako_apps && hako deploy nanika.yml

39. όονॲཧ • hako oneshot Ͱ service Λ࢖ΘͣʹɺRunTask Ͱ୯ ൃͷλεΫΛ࣮ߦͰ͖Δ •

    ࣾ಺Ͱ͸ kuroko2 ͷλεΫͱ࣮ͯ͠ߦͰ͖ΔΑ͏ʹ ੔උ • kuroko2 ʹ͍ͭͯ͸ http://techlife.cookpad.com/ entry/2015/12/07/195732

40. σϓϩΠ࣌ͷϑοΫ • Hako Ͱ͸ script ͱݺশ • σϓϩΠ࣌ʹ΍ͬͯΔ͜ͱ • Route53

    ͷࣗಈઃఆ • nginx ίϯςφͷΞΫηε੍ݶͷઃఆ • σϓϩΠ͢ΔΠϝʔδͷϦϏδϣϯΛ Jenkins ͷ݁Ռ ͔Βܾఆ • ౳ʑ

41. Φʔτεέʔϧ • AutoScaling Group Λར༻͠ɺΫϥελ͝ͱʹΠϯ ελϯεΛ૿ݮͰ͖ΔΑ͏ʹ • ࠓͷͱ͜ΖεέʔϧΠϯ͸ͤͣɺσϓϩΠ࣌ (service ͷ࡞੒ɺߋ৽࣌)

    ʹΠϯελϯεͷΩϟύ γςΟ͕଍Γͯͳ͔ͬͨΒɺAutoScaling Group ͷ ΩϟύγςΟΛ্͛ͯεέʔϧΞ΢τ

42. ϩΪϯά • Docker ͷ log driver ΛࢦఆͰ͖Δ • fluentd log

    driver Λ࢖ͬͯɺϗετଆʹ fluentd Λཱͯ ͯɺ͔ͦ͜Β CloudWatch Logs ΁సૹ • service ໊΍ίϯςφ໊Λ log stream ͷ໊લʹؚΊΔ Α͏ʹ͍ͯ͠Δ • ద౰ͳΞϓϦͰαʔϏε͝ͱʹϩάΛӾཡͰ͖ΔΑ͏ʹ

43. )BLP
    ʹͳͬͯΑ͔ͬͨ఺ • ΠϯελϯεΛखಈͰ࡞੒͠ͳͯ͘Α͍ • AutoScaling Group ͷΩϟύγςΟΛ૿΍͚ͩ͢ • ΞϓϦέʔγϣϯͷఆٛΛɺ։ൃऀ͕ࣗ༝ʹӾཡɾߋ৽ Ͱ͖ΔΑ͏ʹͳͬͨ

    • ґཔͰ͸ͳ͘ pull-request ʹ • Route 53 ͷઃఆͳͲɺయܕతͳ࡞ۀΛࣗಈԽͰ͖ͨ • ݁Ռɺؾܰʹࣾ಺ΞϓϦ͕࡞ΒΕΔΑ͏ʹͳͬͨ

44. ࠓޙͷల๬ • ϩΪϯάΛվળ͍ͨ͠ • ΞϓϦέʔγϣϯͷϩάΛଈ࠲ʹ֬ೝ͍ͨ͠ͱ͖ ͕͋Δ͕ɺݱঢ়Ͱ͖͍ͯͳ͍ • CloudWatch Logs ʹอଘ͢Δͷ͸ͦͷ··Ͱɺಉ

    ࣌ʹ଎ใΛϩʔΧϧϑΝΠϧʹॻ͘Α͏ʹ͢Δ?

45. ࠓޙͷల๬ • ECS Ҏ֎ͷαϙʔτ? • ͪΐ͏ͲઌिɺDocker 1.12 Ͱ orchestration ػೳ

    ͷڧԽ͕ൃද͞Εͨ • ͜ͷ service Λ Hako ͔Β੍ޚͰ͖ΔͱΑͦ͞͏ • https://blog.docker.com/2016/06/docker-1-12- built-in-orchestration/