Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.
Read instantly on your browser with Kindle for Web.
Using your mobile phone camera - scan the code below and download the Kindle app.
Follow the authors
OK
Data Engineering with AWS Cookbook: A recipe-based approach to help you tackle data engineering problems with AWS services
Purchase options and add-ons
Master AWS data engineering services and techniques for orchestrating pipelines, building layers, and managing migrations
Key Features
- Get up to speed with the different AWS technologies for data engineering
- Learn the different aspects and considerations of building data lakes, such as security, storage, and operations
- Get hands on with key AWS services such as Glue, EMR, Redshift, QuickSight, and Athena for practical learning
- Purchase of the print or Kindle book includes a free PDF eBook
Book Description
Performing data engineering with Amazon Web Services (AWS) combines AWS's scalable infrastructure with robust data processing tools, enabling efficient data pipelines and analytics workflows. This comprehensive guide to AWS data engineering will teach you all you need to know about data lake management, pipeline orchestration, and serving layer construction.
Through clear explanations and hands-on exercises, you’ll master essential AWS services such as Glue, EMR, Redshift, QuickSight, and Athena. Additionally, you’ll explore various data platform topics such as data governance, data quality, DevOps, CI/CD, planning and performing data migration, and creating Infrastructure as Code. As you progress, you will gain insights into how to enrich your platform and use various AWS cloud services such as AWS EventBridge, AWS DataZone, and AWS SCT and DMS to solve data platform challenges.
Each recipe in this book is tailored to a daily challenge that a data engineer team faces while building a cloud platform. By the end of this book, you will be well-versed in AWS data engineering and have gained proficiency in key AWS services and data processing techniques. You will develop the necessary skills to tackle large-scale data challenges with confidence.
What you will learn
- Define your centralized data lake solution, and secure and operate it at scale
- Identify the most suitable AWS solution for your specific needs
- Build data pipelines using multiple ETL technologies
- Discover how to handle data orchestration and governance
- Explore how to build a high-performing data serving layer
- Delve into DevOps and data quality best practices
- Migrate your data from on-premises to AWS
Who this book is for
If you're involved in designing, building, or overseeing data solutions on AWS, this book provides proven strategies for addressing challenges in large-scale data environments. Data engineers as well as big data professionals looking to enhance their understanding of AWS features for optimizing their workflow, even if they're new to the platform, will find value. Basic familiarity with AWS security (users and roles) and command shell is recommended.
Table of Contents
- Managing Data Lake Storage
- Sharing Your Data Across Environments and Accounts
- Ingesting and Transforming Your Data with AWS Glue
- A Deep Dive into AWS Orchestration Frameworks
- Running Big Data Workloads with Amazon EMR
- Governing Your Platform
- Data Quality Management
- DevOps – Defining IaC and Building CI/CD Pipelines
- Monitoring Data Lake Cloud Infrastructure
- Building a Serving Layer with AWS Analytics Services
- Migrating to AWS – Steps, Strategies, and Best Practices for Modernizing Your Analytics and Big Data Workloads
- Harnessing the Power of AWS for Seamless Data Warehouse Migration
- Strategizing Hadoop Migrations – Cost, Data, and Workflow Modernization with AWS
- ISBN-101805127284
- ISBN-13978-1805127284
- PublisherPackt Publishing
- Publication dateNovember 29, 2024
- LanguageEnglish
- Dimensions7.5 x 1.19 x 9.25 inches
- Print length528 pages
Frequently bought together

Customers who viewed this item also viewed
- Data Engineering with AWS: Acquire the skills to design and build AWS-based data transformation pipelines like a proPaperbackFREE Shipping on orders over $35 shipped by AmazonGet it as soon as Monday, Sep 21
- AWS Data Engineering Cookbook: Practical Recipes for Scalable Data Pipelines and Analytics on AWSPaperbackFREE Shipping on orders over $35 shipped by AmazonGet it as soon as Monday, Sep 21
- AWS Certified Data Engineer – Associate Exam Prep and Study Guide: 500+ Practice Questions & Answer Explanations | Hands-On Labs | Exam Tips | Comprehensive Coverage of All Exam DomainsPaperbackFREE Shipping on orders over $35 shipped by AmazonGet it as soon as Monday, Sep 21
- Data Engineering Projects with Python & SQL: Build Real ETL Pipelines, Data Warehouses & Analytics Systems (Beginner to Job-Ready, 2026)PaperbackFREE Shipping on orders over $35 shipped by AmazonGet it as soon as Monday, Sep 21
- AWS Cookbook: Recipes for Success on AWSPaperbackFREE Shipping by AmazonGet it as soon as Saturday, Sep 19Only 7 left in stock (more on the way).
- Data Engineering with AWS: Learn how to design and build cloud-based data transformation pipelines using AWSPaperbackFREE Shipping by AmazonGet it as soon as Thursday, Sep 24Only 1 left in stock - order soon.
Customers also bought or read
- Data Engineering with AWS: Acquire the skills to design and build AWS-based data transformation pipelines like a pro
Paperback$29.41$29.41Delivery Mon, Sep 21 - Fundamentals of Data Engineering: Plan and Build Robust Data Systems
Paperback$40.00$40.00FREE delivery Sep 27 - Oct 14 - Serverless ETL and Analytics with AWS Glue: Your comprehensive reference guide to learning about AWS Glue and its features
Paperback$41.99$41.99FREE delivery Mon, Sep 21 - Data Pipelines Pocket Reference: Moving and Processing Data for Analytics
Paperback$16.93$16.93Delivery Sat, Sep 19 - System Design on AWS: Building and Scaling Enterprise Solutions
Paperback$51.10$51.10FREE delivery Sat, Sep 19 - Data Engineering with Databricks Cookbook: Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake
Paperback$35.99$35.99FREE delivery Mon, Sep 21 - The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling
Paperback$38.44$38.44FREE delivery Sat, Sep 19 - AWS Certified Data Engineer – Associate Exam Notes & Practice Tests
Paperback$29.99$29.99Delivery Mon, Sep 21 - Building Modern Data Applications Using Databricks Lakehouse: Develop, optimize, and monitor data pipelines on Databricks
Paperback$46.99$46.99FREE delivery Mon, Sep 21 - Python Machine Learning By Example: Unlock machine learning best practices with real-world use cases
Paperback$29.55$29.55Delivery Mon, Sep 21 - Data Engineering with Google Cloud Platform: A guide to leveling up as a data engineer by building a scalable data platform with Google Cloud
Paperback$24.33$24.33Delivery Mon, Sep 21 - AWS Cloud Projects: Strengthen your AWS skills through practical projects, from websites to advanced AI applications
Paperback$26.91$26.91Delivery Oct 6 - 14 - The Self-Taught Cloud Computing Engineer: A comprehensive professional study guide to AWS, Azure, and GCP
Paperback$29.99$29.99Delivery Mon, Sep 21 - Kafka: The Definitive Guide: Real-Time Data and Stream Processing at Scale
Paperback$43.99$43.99FREE delivery Sat, Sep 19 - Mathematics of Machine Learning: Master linear algebra, calculus, and probability for machine learning
Paperback$44.30$44.30FREE delivery Mon, Sep 21 - Data Wrangling with SQL: A hands-on guide to manipulating, wrangling, and engineering data using SQL
Paperback$38.99$38.99FREE delivery Mon, Sep 21 - Amazon Redshift Cookbook: Recipes for building modern data warehousing solutions
Paperback$45.30$45.30$3.99 delivery Sep 22 - 25 - AWS for Solutions Architects: Design and scale secure AWS architectures with GenAI strategies and real-world patterns
Paperback$32.99$32.99Delivery Mon, Sep 21 - Data Pipelines with Apache Airflow, Second Edition: Orchestration for data and AI
Paperback$56.99$56.99FREE delivery Mon, Sep 21 - SQL for Data Analysis: Advanced Techniques for Transforming Data into Insights
Paperback$36.49$36.49FREE delivery Sat, Sep 19 - Machine Learning with PyTorch and Scikit-Learn: Develop machine learning and deep learning models with Python#1 Best SellerSpeech & Audio Processing
Paperback$36.05$36.05FREE delivery Sat, Sep 19 - Ace the Data Engineering Interview: Questions and Answers for Python, SQL, Data Modeling and More
Paperback$19.99$19.99Delivery Mon, Sep 21 - Azure Data Engineering Cookbook: Get well versed in various data engineering techniques in Azure using this recipe-based guide, 2nd Edition
Paperback$24.97$24.97Delivery Mon, Sep 21 - AWS Certified Data Engineer Associate Study Guide: In-Depth Guidance and Practice
Paperback$39.70$39.70FREE delivery Sat, Sep 19 - Practical SQL, 2nd Edition: A Beginner's Guide to Storytelling with Data#1 Best SellerComputer Programming Structured Design
Paperback$19.99$19.99Delivery Sat, Sep 19 - Math for Deep Learning: What You Need to Know to Understand Neural Networks
Paperback$35.48$35.48FREE delivery Sat, Sep 19 - Mastering Terraform: A practical guide to building and deploying infrastructure on AWS, Azure, and GCP
Paperback$37.99$37.99FREE delivery Mon, Sep 21
Editorial Reviews
About the Author
Trâm Ngọc Phạm is a senior data architect with over a decade of hands-on experience working in the big data and AI field, from playing a lead role in tailoring cloud data platforms to BI and analytics use cases for enterprises in Vietnam. While working as a Senior Data and Analytics consultant for the AWS Professional Services team, she specialized in guiding finance and telco companies across Southeast Asian countries to build enterprise-scale data platforms and drive analytics use cases that utilized AWS services and big data tools.
Gonzalo Herreros González is a principal data architect. He holds a bachelor's degree in computer science and a master's degree in data analytics. He has experience of over a decade in big data and two decades of software development, both in AWS and on-premises.Previously, he worked at MasterCard where he achieved the first PCI-DSS Hadoop cluster in the world. More recently, he worked at AWS for over 6 years, building data pipelines for the internal network data, and later, as an architect in the AWS Glue service team, building transforms for AWS Glue Studio and helping large customers succeed with AWS data services.
Viquar Khan is a senior data architect at AWS Professional Services and brings over 20 years of expertise in finance and data analytics, empowering global financial institutions to harness the full potential of AWS technologies. He designs cutting-edge, customized data solutions tailored to complex industry needs. A polyglot developer skilled in Java, Scala, Python, and other languages, Viquar has excelled in various technical roles. As an expert group member of JSR368 (JavaTM Message Service 2.1), he has shaped industry standards and actively contributes to open source projects such as Apache Spark and Terraform. His technical insights have reached and benefited over 6.7 million users on Stack Overflow.
Huda Nofal is a seasoned data engineer with over 7 years of experience at Amazon, where she has played a key role in helping internal business teams achieve their data goals. With deep expertise in AWS services, she has successfully designed and implemented data pipelines that power critical decision-making processes across various organizations. Huda's work primarily focuses on leveraging Redshift, Glue, data lakes, and Lambda to create scalable, efficient data solutions.Product details
- Publisher : Packt Publishing
- Publication date : November 29, 2024
- Language : English
- Print length : 528 pages
- ISBN-10 : 1805127284
- ISBN-13 : 978-1805127284
- Item Weight : 1.98 pounds
- Dimensions : 7.5 x 1.19 x 9.25 inches
- Best Sellers Rank: #1,078,091 in Books (See Top 100 in Books)
- #362 in Data Modeling & Design (Books)
- #392 in Data Mining (Books)
- #537 in Data Processing
- Customer Reviews:
About the authors

Viquar Khan, a Senior Data Architect at AWS Professional Services, brings over 20+ years of expertise in finance and data analytics, empowering global financial institutions to harness the full potential of AWS technologies. He designs cutting-edge, customized data solutions tailored to complex industry needs. A polyglot developer skilled in Java, Scala, Python, and other languages, Viquar has excelled in various technical roles. As an expert group member of JSR 368 (JavaTM Message Service 2.1), he has shaped industry standards and actively contributes to open-source projects like Apache Spark and Terraform. His technical insights have reached and benefited over 6.7 million users on Stack Overflow.

Gonzalo Herreros González is currently a Principal Data Architect at Red hat. He holds a bachelor's degree in computer science and a master's degree in data analytics. He has experience of over a decade in Big Data and two decades of software development, both on AWS and on-premises.
Previously, he worked at MasterCard where he achieved the first PCI-DS Hadoop cluster in the world. Recently, he worked at AWS for over 6 years, building data pipelines for the internal network data, and later, as an architect in the AWS Glue service team, building transforms for AWS Glue Studio and helping large customers succeed with AWS data services.

Discover more of the author’s books, see similar authors, read book recommendations and more.

Discover more of the author’s books, see similar authors, read book recommendations and more.
















