book

Distributed Systems with Node.js

by Thomas Hunter

November 2020

Intermediate to advanced

388 pages

11h 1m

English

O'Reilly Media, Inc.

Book available

Start your free trial

Related skills

Node.js

Associated roles

Backend developer
Frontend developer

Target AudienceGoalsConventions Used in This BookUsing Code ExamplesO’Reilly Online LearningHow to Contact UsAcknowledgments
The Single-Threaded Nature of JavaScriptQuick Node.js OverviewThe Node.js Event LoopEvent Loop PhasesCode ExampleEvent Loop TipsSample ApplicationsService RelationshipProducer ServiceConsumer Service
Request and Response with HTTPHTTP PayloadsHTTP SemanticsHTTP CompressionHTTPS / TLSJSON over HTTPThe Dangers of Serializing POJOsAPI Facade with GraphQLGraphQL SchemaQueries and ResponsesGraphQL ProducerGraphQL ConsumerRPC with gRPCProtocol BuffersgRPC ProducergRPC Consumer
The Cluster ModuleA Simple ExampleRequest DispatchingCluster ShortcomingsReverse Proxies with HAProxyIntroduction to HAProxyLoad Balancing and Health ChecksCompressionTLS TerminationRate Limiting and Back PressureSLA and Load TestingIntroduction to AutocannonRunning a Baseline Load TestReverse Proxy ConcernsProtocol ConcernsComing Up with SLOs
EnvironmentsLogging with ELKRunning ELK via DockerTransmitting Logs from Node.jsCreating a Kibana DashboardRunning Ad-Hoc QueriesMetrics with Graphite, StatsD, and GrafanaRunning via DockerTransmitting Metrics from Node.jsCreating a Grafana DashboardNode.js Health IndicatorsDistributed Request Tracing with ZipkinHow Does Zipkin Work?Running Zipkin via DockerTransmitting Traces from Node.jsVisualizing a Request TreeVisualizing Microservice DependenciesHealth ChecksBuilding a Health CheckTesting the Health CheckAlerting with CabotCreate a Twilio Trial AccountRunning Cabot via DockerCreating a Health Check
Introduction to DockerContainerizing a Node.js ServiceDependency StageRelease StageFrom Image to ContainerRebuilding and Versioning an ImageBasic Orchestration with Docker ComposeComposing Node.js ServicesInternal Docker RegistryRunning the Docker RegistryPushing and Pulling to the RegistryRunning a Docker Registry UI
Build Pipeline with Travis CICreating a Basic ProjectConfiguring Travis CITesting a Pull RequestAutomated TestingUnit TestsIntegration TestsCode Coverage EnforcementDeploying to HerokuCreate a Heroku AppConfigure Travis CIDeploy Your ApplicationModules, Packages, and SemVerNode.js ModulesSemVer (Semantic Versioning)npm Packages and the npm CLIInternal npm RegistryRunning VerdaccioConfiguring npm to Use VerdaccioPublishing to Verdaccio
Introduction to KubernetesKubernetes OverviewKubernetes ConceptsStarting KubernetesGetting StartedDeploying an ApplicationKubectl SubcommandsKubectl Configuration FilesService DiscoveryModifying DeploymentsScaling Application InstancesDeploying New Application VersionsRolling Back Application Deployments
The Death of a Node.js ProcessProcess ExitExceptions, Rejections, and Emitted ErrorsSignalsBuilding Stateless ServicesAvoiding Memory LeaksBounded In-Process CachesExternal Caching with MemcachedIntroducing MemcachedRunning MemcachedCaching Data with MemcachedData Structure MutationsDatabase Connection ResilienceRunning PostgreSQLAutomatic ReconnectionConnection PoolingSchema Migrations with KnexConfiguring KnexCreating a Schema MigrationApplying a MigrationRolling Back a MigrationLive MigrationsIdempotency and Messaging ResilienceHTTP Retry LogicCircuit Breaker PatternExponential BackoffResilience TestingRandom CrashesEvent Loop PausesRandom Failed Async Operations

The ID Generation ProblemIntroduction to RedisRedis OperationsStringsListsSetsHashSorted SetsGeneric CommandsOther TypesSeeking AtomicityTransactionsLua ScriptingWriting a Lua Script FileLoading the Lua ScriptTying It All Together
Wrangling RepositoriesRecognizing Attack SurfaceParameter Checking and DeserializationMalicious npm PackagesApplication ConfigurationEnvironment VariablesConfiguration FilesSecrets ManagementUpgrading DependenciesAutomatic Upgrades with GitHub DependabotManual Upgrades with npm CLIUnpatched VulnerabilitiesUpgrading Node.jsNode.js LTS ScheduleUpgrade Approach
Linux: Build from SourceLinux: Install Precompiled BinarymacOS: Install via Homebrew
macOS: Install Docker Desktop for MacLinux: Convenient Install Script
Linux: Debian Package and Precompiled BinarymacOS: Install via Homebrew

Overview

Many companies, from startups to Fortune 500 companies alike, use Node.js to build performant backend services. And engineers love Node.js for its approachable API and familiar syntax. Backed by the world's largest package repository, Node's enterprise foothold is only expected to grow.

In this hands-on guide, author Thomas Hunter II proves that Node.js is just as capable as traditional enterprise platforms for building services that are observable, scalable, and resilient. Intermediate to advanced Node.js developers will find themselves integrating application code with a breadth of tooling from each layer of a modern service stack.

Learn why running redundant copies of the same Node.js service is necessary
Know which protocol to choose, depending on the situation
Fine-tune your application containers for use in production
Track down errors in a distributed setting to determine which service is at fault
Simplify app code and increase performance by offloading work to a reverse proxy
Build dashboards to monitor service health and throughput
Find out why so many different tools are required when operating in an enterprise environment