Tailoring Small Language Models
for Enterprise Use Cases
Julien Simon, Chief Evangelist
julien@arcee.ai
linkedin.com/in/juliensimon
youtube.com/juliensimonfr
Why rent your AI models
when you can own them?
🔒
Increase privacy
and compliance
👔
Tailor models to
your use cases
Maximize ROI
📈
Right-size
cost-performance
🚗
Tailoring Small Language Models for Enterprise Use Cases
Arcee.ai - The Open SLM leader
State-of-the-art tailoring stack
Spectrum (continuous pre-training), MergeKit (merging), DistilKit (distillation), EvolKit (dataset improvement)
Best-in-class models based on open architectures
Hugging Face OpenLLM Leaderboard benchmarks
Qwen2 72B
🥇
Best Arabic model
Llama 3.1 70B
🥇
Best 70B model
Qwen2 1.5B
🥇
Best 1.5B model
Llama 3.1 8B
🥇
Best 8B model
A modern model adaptation workflow
Pretrained
model
Domain-
adapted
model
Instruction-
tuned model
Aligned
model
Alignment
Merging
instruction-following
behavior
Instruction-
tuned model
Merging
domain
knowledge
Domain-
adapted
model
Merging
alignment
behavior
Aligned
model
Merging steps can be combined, e.g., merge with a domain-adapted and aligned model
📄📄📄
Unlabeled
domain dataset
📄📄📄
Preference dataset
📄📄📄
Q&A dataset
Continuous
pre-training
(CPT)
Instruction
fine-tuning
(IFT)
Spectrum DPO
LoRA
EvolKit
Try it at supernova.arcee.ai
Book a demo at www.arcee.ai/book-a-demo
Deploy it in one click on the AWS Marketplace
Bye bye closed models
AI is changing all businesses.
Make it yours and own it.
Julien Simon, Chief Evangelist
julien@arcee.ai

More Related Content

PDF
Tailoring Small Language Models for Enterprise Use Cases
PDF
Arcee AI - building and working with small language models (06/25)
PDF
Building High-Quality Domain-Specific Models with Mergekit
PDF
Implementing high-quality and cost-effiient AI applications with small langua...
PDF
Tailoring Small Language Models for Enterprise Use Cases
PDF
Quick Start Guide To Large Language Models Second Edition Sinan Ozdemir
PDF
Small Language Models Explained A Beginners Guide.pdf
PDF
What are Small Language Models (SLMs) – A Brief Guide | USAII®
Tailoring Small Language Models for Enterprise Use Cases
Arcee AI - building and working with small language models (06/25)
Building High-Quality Domain-Specific Models with Mergekit
Implementing high-quality and cost-effiient AI applications with small langua...
Tailoring Small Language Models for Enterprise Use Cases
Quick Start Guide To Large Language Models Second Edition Sinan Ozdemir
Small Language Models Explained A Beginners Guide.pdf
What are Small Language Models (SLMs) – A Brief Guide | USAII®

Similar to Tailoring Small Language Models for Enterprise Use Cases (14)

PPTX
Large Language Models vs Small Language Models
PDF
Large Language Models.pdf
PDF
Crafting Your Customized Legal Mastery: A Guide to Building Your Private LLM
PDF
Comparison of Large Language Models The Ultimate Guide.pdf
PDF
Quick Overview of the Top 9 Popular LLMs.pdf
PDF
Top Comparison of Large Language ModelsLLMs Explained (2).pdf
PDF
Top Comparison of Large Language ModelsLLMs Explained.pdf
PDF
Unlocking the Power of Generative AI An Executive's Guide.pdf
PDF
katonic-unlockingthepowerofgenerativeaianexecutivesguide-230516015702-791c649...
PDF
Improving Text Embeddings With Large Language Models (LLMs)
PDF
The Significance of Large Language Models (LLMs) in Generative AI2.pdf
PPTX
Large Language Models: Diving into GPT, LLaMA, and More
PDF
Top Comparison of Large Language ModelsLLMs Explained.pdf
PDF
1721436375967hhhhhhhhhhhhhuuuuuuuuuu.pdf
Large Language Models vs Small Language Models
Large Language Models.pdf
Crafting Your Customized Legal Mastery: A Guide to Building Your Private LLM
Comparison of Large Language Models The Ultimate Guide.pdf
Quick Overview of the Top 9 Popular LLMs.pdf
Top Comparison of Large Language ModelsLLMs Explained (2).pdf
Top Comparison of Large Language ModelsLLMs Explained.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdf
katonic-unlockingthepowerofgenerativeaianexecutivesguide-230516015702-791c649...
Improving Text Embeddings With Large Language Models (LLMs)
The Significance of Large Language Models (LLMs) in Generative AI2.pdf
Large Language Models: Diving into GPT, LLaMA, and More
Top Comparison of Large Language ModelsLLMs Explained.pdf
1721436375967hhhhhhhhhhhhhuuuuuuuuuu.pdf
Ad

More from Julien SIMON (20)

PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Trying to figure out MCP by actually building an app from scratch with open s...
PDF
deep_dive_multihead_latent_attention.pdf
PDF
Deep Dive: Model Distillation with DistillKit
PDF
Deep Dive: Parameter-Efficient Model Adaptation with LoRA and Spectrum
PDF
Julien Simon - Deep Dive: Compiling Deep Learning Models
PDF
Julien Simon - Deep Dive - Optimizing LLM Inference
PDF
Julien Simon - Deep Dive - Accelerating Models with Better Attention Layers
PDF
Julien Simon - Deep Dive - Quantizing LLMs
PDF
Julien Simon - Deep Dive - Model Merging
PDF
An introduction to computer vision with Hugging Face
PDF
Reinventing Deep Learning
 with Hugging Face Transformers
PDF
Building NLP applications with Transformers
PPTX
Building Machine Learning Models Automatically (June 2020)
PDF
Starting your AI/ML project right (May 2020)
PPTX
Scale Machine Learning from zero to millions of users (April 2020)
PPTX
An Introduction to Generative Adversarial Networks (April 2020)
PPTX
AIM410R1 Deep learning applications with TensorFlow, featuring Fannie Mae (De...
PDF
AIM361 Optimizing machine learning models with Amazon SageMaker (December 2019)
PDF
AIM410R Deep Learning Applications with TensorFlow, featuring Mobileye (Decem...
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Trying to figure out MCP by actually building an app from scratch with open s...
deep_dive_multihead_latent_attention.pdf
Deep Dive: Model Distillation with DistillKit
Deep Dive: Parameter-Efficient Model Adaptation with LoRA and Spectrum
Julien Simon - Deep Dive: Compiling Deep Learning Models
Julien Simon - Deep Dive - Optimizing LLM Inference
Julien Simon - Deep Dive - Accelerating Models with Better Attention Layers
Julien Simon - Deep Dive - Quantizing LLMs
Julien Simon - Deep Dive - Model Merging
An introduction to computer vision with Hugging Face
Reinventing Deep Learning
 with Hugging Face Transformers
Building NLP applications with Transformers
Building Machine Learning Models Automatically (June 2020)
Starting your AI/ML project right (May 2020)
Scale Machine Learning from zero to millions of users (April 2020)
An Introduction to Generative Adversarial Networks (April 2020)
AIM410R1 Deep learning applications with TensorFlow, featuring Fannie Mae (De...
AIM361 Optimizing machine learning models with Amazon SageMaker (December 2019)
AIM410R Deep Learning Applications with TensorFlow, featuring Mobileye (Decem...
Ad

Recently uploaded (20)

PPTX
Report in SIP_Distance_Learning_Technology_Impact.pptx
PPT
Storage Area Network Best Practices from HP
PDF
CCUS-as-the-Missing-Link-to-Net-Zero_AksCurious.pdf
PDF
Examining Bias in AI Generated News Content.pdf
PDF
Decision Optimization - From Theory to Practice
PPTX
Rise of the Digital Control Grid Zeee Media and Hope and Tivon FTWProject.com
PDF
Fitaura: AI & Machine Learning Powered Fitness Tracker
PDF
Intravenous drug administration application for pediatric patients via augmen...
PDF
Ebook - The Future of AI A Comprehensive Guide.pdf
PDF
Addressing the challenges of harmonizing law and artificial intelligence tech...
PDF
EGCB_Solar_Project_Presentation_and Finalcial Analysis.pdf
PDF
Optimizing bioinformatics applications: a novel approach with human protein d...
PPTX
Information-Technology-in-Human-Society.pptx
PDF
ELLIE29.pdfWETWETAWTAWETAETAETERTRTERTER
PDF
The AI Revolution in Customer Service - 2025
PDF
Internet of Things (IoT) – Definition, Types, and Uses
PDF
Human Computer Interaction Miterm Lesson
PPTX
Presentation - Principles of Instructional Design.pptx
PDF
Gestión Unificada de los Riegos Externos
PDF
NewMind AI Journal Monthly Chronicles - August 2025
Report in SIP_Distance_Learning_Technology_Impact.pptx
Storage Area Network Best Practices from HP
CCUS-as-the-Missing-Link-to-Net-Zero_AksCurious.pdf
Examining Bias in AI Generated News Content.pdf
Decision Optimization - From Theory to Practice
Rise of the Digital Control Grid Zeee Media and Hope and Tivon FTWProject.com
Fitaura: AI & Machine Learning Powered Fitness Tracker
Intravenous drug administration application for pediatric patients via augmen...
Ebook - The Future of AI A Comprehensive Guide.pdf
Addressing the challenges of harmonizing law and artificial intelligence tech...
EGCB_Solar_Project_Presentation_and Finalcial Analysis.pdf
Optimizing bioinformatics applications: a novel approach with human protein d...
Information-Technology-in-Human-Society.pptx
ELLIE29.pdfWETWETAWTAWETAETAETERTRTERTER
The AI Revolution in Customer Service - 2025
Internet of Things (IoT) – Definition, Types, and Uses
Human Computer Interaction Miterm Lesson
Presentation - Principles of Instructional Design.pptx
Gestión Unificada de los Riegos Externos
NewMind AI Journal Monthly Chronicles - August 2025

Tailoring Small Language Models for Enterprise Use Cases

  • 1. Tailoring Small Language Models for Enterprise Use Cases Julien Simon, Chief Evangelist [email protected] linkedin.com/in/juliensimon youtube.com/juliensimonfr
  • 2. Why rent your AI models when you can own them? 🔒 Increase privacy and compliance 👔 Tailor models to your use cases Maximize ROI 📈 Right-size cost-performance 🚗
  • 4. Arcee.ai - The Open SLM leader State-of-the-art tailoring stack Spectrum (continuous pre-training), MergeKit (merging), DistilKit (distillation), EvolKit (dataset improvement) Best-in-class models based on open architectures Hugging Face OpenLLM Leaderboard benchmarks Qwen2 72B 🥇 Best Arabic model Llama 3.1 70B 🥇 Best 70B model Qwen2 1.5B 🥇 Best 1.5B model Llama 3.1 8B 🥇 Best 8B model
  • 5. A modern model adaptation workflow Pretrained model Domain- adapted model Instruction- tuned model Aligned model Alignment Merging instruction-following behavior Instruction- tuned model Merging domain knowledge Domain- adapted model Merging alignment behavior Aligned model Merging steps can be combined, e.g., merge with a domain-adapted and aligned model 📄📄📄 Unlabeled domain dataset 📄📄📄 Preference dataset 📄📄📄 Q&A dataset Continuous pre-training (CPT) Instruction fine-tuning (IFT) Spectrum DPO LoRA EvolKit
  • 6. Try it at supernova.arcee.ai Book a demo at www.arcee.ai/book-a-demo Deploy it in one click on the AWS Marketplace
  • 7. Bye bye closed models AI is changing all businesses. Make it yours and own it. Julien Simon, Chief Evangelist [email protected]