Download as PDF, PPTX
Uploaded byDocker, Inc.
Using Docker, Neo4j, and Spring Cloud for Developing Microservices
This document outlines a presentation about using Docker, Neo4j, and Spring Cloud for developing microservices. Specifically, it discusses using these technologies to build an application that ranks Twitter profiles using the PageRank algorithm. It provides code examples and descriptions of how to connect Neo4j and Apache Spark to run PageRank jobs on the graph database, create Spring Data repositories and REST APIs, interface with the Twitter API, and build a dashboard to view profile rankings.
More Related Content
Similar to Using Docker, Neo4j, and Spring Cloud for Developing Microservices
Using Docker, Neo4j, and Spring Cloud for Developing Microservices
- 1. Unless otherwise indicated,these slides are © 2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Using Docker, Neo4j, and Spring Cloud for Developing Microservices Kenny Bastani, Spring Developer Advocate, Pivotal @kennybastani
- 2.
- 3. Ranking Twitter Profiles UsingPageRank 3 https://github.com/kbastani/spring-boot-graph-processing-example
- 4.
- 5.
- 6.
- 7.
- 8.
- 9. https://github.com/kbastani/spring-boot-graph-processing-example Tools we’ll beusing ! Spring Boot ! Neo4j ! Apache Spark ! Docker ! RabbitMQ 9
- 10.
- 11.
- 12.
- 13.
- 14.
- 15. Connecting Neo4j andApache Spark …to submit PageRank jobs 15 https://github.com/kbastani/spring-boot-graph-processing-example
- 16. https://github.com/kbastani/spring-boot-graph-processing-example Request new ApacheSpark job 16 Algorithm Type Relationship Type
- 17. https://github.com/kbastani/spring-boot-graph-processing-example Export Neo4j graphto HDFS 17 New Job Request HDFS Path: /../../graph.csv Job Type: pagerank
- 18. https://github.com/kbastani/spring-boot-graph-processing-example Encoding a graphas an edge list 18 edge list G B H B I B K B E B F B J B D B G E H E I E K E …
- 19. https://github.com/kbastani/spring-boot-graph-processing-example Import edge listto Apache Spark 19 Process Job Request HDFS Path: /../../graph.csv Job Type: pagerank graph.csv 0 1 1 2 2 3 0 3 2 1 …
- 20. https://github.com/kbastani/spring-boot-graph-processing-example Apply results backto Neo4j 20 Completed Job HDFS Path: /../../results.csv Job Type: pagerank results.csv 0 .56 1 .42 2 .14 3 .25 …
- 21.
- 22.
- 23.
- 24.
- 25.
- 26. 26 Creating Spring DataNeo4j Repositories https://github.com/kbastani/spring-boot-graph-processing-example
- 27. https://github.com/kbastani/spring-boot-graph-processing-example What our applicationneeds ! Repositories • User repository (to manage and import users) • Follows repository (to manage and import following relationships) • Custom Cypher queries mapped to repository methods ! Domain model • User — (our node entity) • Follows — (our relationship entity) ! REST API • Expose the resources of the domain as a REST API 27
- 28. Creating Spring DataNeo4j Repositories 28 https://github.com/kbastani/spring-boot-graph-processing-example
- 29. Creating Spring DataNeo4j Repositories 29 https://github.com/kbastani/spring-boot-graph-processing-example
- 30. Creating Spring DataNeo4j Repositories 30 https://github.com/kbastani/spring-boot-graph-processing-example
- 31. Creating Spring DataNeo4j Repositories 31 https://github.com/kbastani/spring-boot-graph-processing-example
- 32. Creating Spring DataNeo4j Repositories 32 https://github.com/kbastani/spring-boot-graph-processing-example
- 33. Creating Spring DataNeo4j Repositories 33 https://github.com/kbastani/spring-boot-graph-processing-example
- 34. Exposing repository APIsusing Spring Data REST 34 https://github.com/kbastani/spring-boot-graph-processing-example
- 35. Exposing repository APIsusing Spring Data REST 35 https://github.com/kbastani/spring-boot-graph-processing-example
- 36. Exposing repository APIsusing Spring Data REST 36 https://github.com/kbastani/spring-boot-graph-processing-example
- 37. Connecting to theTwitter API 37 https://github.com/kbastani/spring-boot-graph-processing-example
- 38.
- 39. Connecting to theTwitter API 39 https://github.com/kbastani/spring-boot-graph-processing-example
- 40. Connecting to theTwitter API 40 https://github.com/kbastani/spring-boot-graph-processing-example We can override these properties as environment variables at runtime
- 41.
- 42.
- 43. Scheduling new PageRankjobs 43 https://github.com/kbastani/spring-boot-graph-processing-example
- 44.
- 45. Scheduling new PageRankjobs 45 https://github.com/kbastani/spring-boot-graph-processing-example
- 46.
- 47.
- 48.
- 49.
- 50. Adding static webcontent 50 https://github.com/kbastani/spring-boot-graph-processing-example
- 51.
- 52.
- 53.
- 54.
- 55. Creating Spring DataNeo4j Repositories 55 https://github.com/kbastani/spring-boot-graph-processing-example
- 56.
- 57. https://github.com/kbastani/spring-boot-graph-processing-example57 Learn More. StayConnected. ! Twitter: @kennybastani ! Spring: spring.io/team/kbastani ! Blog: kennybastani.com ! GitHub: github.com/kbastani Twitter: twitter.com/springcentral YouTube: spring.io/video LinkedIn: spring.io/linkedin Google Plus: spring.io/gplus