Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.
Read instantly on your browser with Kindle for Web.
Using your mobile phone camera - scan the code below and download the Kindle app.
Follow the author
OK
Domain-Specific Small Language Models: Efficient AI for local deployment
Purchase options and add-ons
When you need a language model to respond accurately and quickly about a specific field of knowledge, the sprawling capacity of a LLM may hurt more than it helps. This book teaches you to build generative AI models optimized for specific fields.
Perfect for cost- or hardware-constrained environments, Small Language Models (SLMs) train on domain specific data for high-quality results in specific tasks. In this book you’ll develop SLMs that can generate everything from Python code to protein structures and antibody sequences—all on commodity hardware.
In Domain-Specific Small Language Models you’ll discover:
• Model sizing best practices
• Open source libraries, frameworks, utilities and runtimes
• Fine-tuning techniques for custom datasets
• Hugging Face’s libraries for SLMs
• Running SLMs on commodity hardware
• Model optimization or quantization
Foreword by Matthew R. Versaggi.
About the technology
Small-footprint language models trained on custom data sets and hosted locally can perform as well as large generalist models in speed and accuracy, often at a fraction of the cost. Domain-Specific Small Language Models shows you how to build privacy-preserving and regulation-compliant SLMs for agentic systems, specialist applications, and deployment on the edge.
About the book
This is a practical book that shows you how to adapt pretrained open source models to your domain using transfer learning and parameter-efficient fine-tuning. You’ll learn to minimize cost through optimization and quantization, develop secure APIs to serve your models, and deploy SLMs on commodity hardware—including small devices. The hands-on examples include integrating SLMs into RAG systems and agentic workflows.
What's inside
• ONNX and other quantization methods
• Integrate SLMs into end-to-end applications
• Deploy SLMs on laptops, smartphones, and other devices
About the reader
For AI engineers familiar with Python.
About the author
Guglielmo Iozzia is a Director of AI and Applied Mathematics at Merck & Co. and a Distinguished Member of the American Society for Artificial Intelligence. He specializes in AI biomedical applications.
The technical editor on this book was Riccardo Mattivi.
Table of Contents
Part 1
1 Small language models
Part 2
2 Tuning for a specific domain
3 End-to-end transformer fine-tuning
4 Running inference
5 Exploring ONNX
6 Quantizing for your production environment
Part 3
7 Generating Python code
8 Generating protein structures
Part 4
9 Advanced quantization techniques
10 Profiling insights
11 Deployment and serving
12 Running on your laptop
13 Creating end-to-end LLM applications
14 Advanced components for LLM applications
15 Test-time compute and small language models
- ISBN-101633436705
- ISBN-13978-1633436701
- Publication dateMay 26, 2026
- LanguageEnglish
- Dimensions7.38 x 0.94 x 9.25 inches
- Print length376 pages
Frequently bought together

Customers who viewed this item also viewed
- Build a Reasoning Model (From Scratch)PaperbackFREE Shipping by AmazonGet it as soon as Sunday, Sep 20
- Build a Large Language Model (From Scratch)PaperbackFREE Shipping by AmazonGet it as soon as Sunday, Sep 20
- Knowledge Graphs and LLMs in Action: Build AI systems using connected dataPaperbackFREE Shipping by AmazonGet it as soon as Monday, Sep 21
- AI Agents in Action, Second Edition: Intelligent workflows with LLMs, MCP, A2A, and morePaperbackFREE Shipping by AmazonGet it as soon as Monday, Sep 21
- Reinforcement Learning from Human Feedback: LLM alignment and post-trainingNathan LambertPaperbackFREE Shipping by AmazonGet it as soon as Monday, Sep 21
- AI Agents and Applications: With LangChain, LangGraph, and MCPPaperbackFREE Shipping by AmazonGet it as soon as Monday, Sep 21
Customers also bought or read
- Build a Reasoning Model (From Scratch)#1 Best SellerProgramming Algorithms
Paperback$47.82$47.82FREE delivery Sun, Sep 20 - Knowledge Graphs and LLMs in Action: Build AI systems using connected data
Paperback$55.99$55.99FREE delivery Mon, Sep 21 - Reinforcement Learning from Human Feedback: LLM alignment and post-training
Just releasedPaperback$59.99$59.99FREE delivery Mon, Sep 21 - AI Agents in Action, Second Edition: Intelligent workflows with LLMs, MCP, A2A, and more#1 New ReleaseNatural Language Processing
Paperback$47.48$47.48FREE delivery Mon, Sep 21 - 30 Agents Every AI Engineer Must Build: Build production-ready agent systems using proven architectures and patterns
Paperback$41.79$41.79FREE delivery Mon, Sep 21 - AI Agents and Applications: With LangChain, LangGraph, and MCP
Paperback$51.69$51.69FREE delivery Mon, Sep 21 - Sutskever's List: Foundational ideas of modern AI#1 New ReleaseComputer Vision & Pattern Recognition
Paperback$49.99$49.99FREE delivery Mon, Sep 21 - Agentic Coding with Claude Code: The everyday developer's guide to agentic coding with Claude Code
Paperback$36.33$36.33FREE delivery Mon, Sep 21 - Build a Large Language Model (From Scratch)#1 Best SellerComputer Neural Networks
Paperback$49.24$49.24FREE delivery Sun, Sep 20 - Deep Learning with PyTorch, Second Edition: Training and applying deep learning and generative AI models
Paperback$51.68$51.68FREE delivery Mon, Sep 21 - Designing Multi-Agent Systems: Principles, Patterns, and Implementation for AI Agents
Paperback$46.39$46.39FREE delivery Mon, Sep 21 - Agentic Spec-Driven Development: A Practical Method for Using AI to Build Complete Specifications for Software, Products, and Knowledge Work
Paperback$39.95$39.95FREE delivery Mon, Sep 21 - 50 ML Projects To Understand LLMs: Investigate transformer mechanisms through data analysis, visualization, and experimentation
Paperback$44.99$44.99FREE delivery Mon, Sep 21 - How to Build and Fine‐Tune a Small Language Model: A Step-by-Step Guide for Beginners, Researchers, and Non-Programmers
Paperback$38.25$38.25FREE delivery Mon, Sep 21 - AI Systems Performance Engineering: Optimizing Model Training and Inference Workloads with GPUs, CUDA, and PyTorch
Paperback$87.70$87.70FREE delivery Mon, Sep 21 - Design Multi-Agent AI Systems Using MCP and A2A: Engineer your own Python-based agentic AI framework with tool use, memory, and multi-agent workflows
Paperback$41.79$41.79FREE delivery Mon, Sep 21 - Building AI Agents with LLMs, RAG, and Knowledge Graphs: A practical guide to autonomous and modern AI agents
Paperback$41.99$41.99FREE delivery Mon, Sep 21 - The Mathematics of Large Language Models: Machine Learning Theory Made Readable: LLMs, Transformers, Diffusion, Neural Networks, Optimization, and ... (The Mathematics of Artificial Intelligence)
Just releasedPaperback$32.99$32.99Delivery Mon, Sep 21 - LLMs in Production: From language models to successful products
Paperback$48.13$48.13FREE delivery Sun, Sep 20 - Hands-On Machine Learning with Scikit-Learn and PyTorch: Concepts, Tools, and Techniques to Build Intelligent Systems
Paperback$77.72$77.72FREE delivery Mon, Sep 21 - LLM Systems Engineering: Training and Building Large Language Models – Engineering AI Models Through Fine-Tuning, Continued Pretraining, and From-Scratch Development
Paperback$37.00$37.00FREE delivery Mon, Sep 21 - Hands-On Large Language Models: Language Understanding and Generation
Paperback$37.68$37.68FREE delivery Mon, Sep 21 - Agentic Architectural Patterns for Building Multi-Agent Systems: Proven design patterns and practices for GenAI, agents, RAG, LLMOps, and enterprise-scale AI systems
Paperback$44.99$44.99FREE delivery Sun, Sep 20 - Vision Language Models: Building VLMs with Hugging Face
Just releasedPaperback$70.87$70.87FREE delivery Sun, Sep 20 - Optimization: A Bootcamp for Machine Learning, Inverse Problems, and Control
Just releasedHardcover$63.86$63.86FREE delivery Sun, Sep 20 - AI Agents in Action: Build, orchestrate, and deploy autonomous multi-agent systems
Paperback$59.99$59.99 - AI Engineering: Building Applications with Foundation Models#1 Best SellerEnterprise Applications
Paperback$52.40$52.40FREE delivery Sun, Sep 20
From the Publisher
“Gives the reader a jumpstart toward making efficient, focused models with well-controlled data.”
Janelle Shane, AI Weirdness
“Effectively cuts through the hype to focus on the tangible business value of localized, efficient artificial intelligence.”
Luca Longo, University College Cork
“A timely and much-needed reference for both researchers and industry practitioners.”
Ahmed Serag, Weill Cornell Medicine
why this book?
Domain-Specific Small Language Models shows how to build compact AI models tuned to a specific industry, workflow, or dataset, rather than relying on oversized general-purpose LLMs.
Readers learn practical techniques for fine-tuning, evaluation, deployment, and optimization, enabling them to run capable models with lower latency, lower infrastructure costs, and tighter control over data and outputs.
The book also helps engineers understand when small language models outperform larger systems in production, especially in environments where privacy, speed, and reliability matter more than raw parameter count.
about Manning
Manning helps developers and tech professionals stay ahead in a fast-moving industry with expert-led books, videos, and projects. Learning never stops, but it’s hard to keep up, so we focus on content that’s practical, clear, and trusted. As an independent publisher, we adapt quickly, from pioneering early-access books to offering DRM-free eBooks. Our series, like "In Action" and "In a Month of Lunches", reflect a commitment to making complex topics accessible.
Deep Learning with Python, Third Edition
|
AI Agents in Action
|
Build a Large Language Model (From Scratch)
|
LLMs in Production: From language models to successful products
|
Data Analysis with LLMs: Text, tables, images and sound (In Action)
|
Causal AI
|
|
|---|---|---|---|---|---|---|
|
Add to Cart
|
Add to Cart
|
Add to Cart
|
Add to Cart
|
Add to Cart
|
Add to Cart
|
|
| Customer Reviews |
4.2 out of 5 stars 42
|
4.0 out of 5 stars 51
|
4.5 out of 5 stars 613
|
4.5 out of 5 stars 36
|
4.8 out of 5 stars 7
|
4.4 out of 5 stars 14
|
| Level of proficiency | Intermediate | Intermediate | Intermediate | Intermediate | Intermediate | Advanced |
| About the reader | For readers with intermediate Python skills. | For intermediate Python programmers. | Readers need intermediate Python skills and some knowledge of machine learning. | For data scientists and ML engineers. | For data scientists and data analysts. | For data scientists and machine learning engineers. |
| Special features | Includes liveBook with out built-in AI assistant. | Includes liveBook with out built-in AI assistant. | Includes liveBook with out built-in AI assistant. | Includes liveBook with out built-in AI assistant. | Includes liveBook with out built-in AI assistant. | Includes liveBook with out built-in AI assistant. |
| Pages | 648 | 344 | 368 | 456 | 232 | 520 |
Editorial Reviews
About the Author
Product details
- Publisher : Manning Publications
- Publication date : May 26, 2026
- Language : English
- Print length : 376 pages
- ISBN-10 : 1633436705
- ISBN-13 : 978-1633436701
- Item Weight : 12.7 ounces
- Dimensions : 7.38 x 0.94 x 9.25 inches
- Best Sellers Rank: #34,748 in Books (See Top 100 in Books)
- #14 in Natural Language Processing (Books)
- #15 in Python Programming
- #23 in Computer Programming Languages
- Customer Reviews:
About the author

Discover more of the author’s books, see similar authors, read book recommendations and more.
















