Openlayer’s Blog

No commitments, unsubscribe any time.

Testing

September 17, 2026

LLM Coding Benchmarks: The Complete Guide September 2026 (Updated)

Development

September 17, 2026

LangSmith Pricing & Alternatives: September 2026 Guide (Updated)

AI

September 17, 2026

Best RAG Embedding Models to Match Your Retrieval Task: September 2026

Observability

September 17, 2026

LLM Pipeline PII Detection and Enforcement (September 2026)

Guardrails

September 17, 2026

Tool-Calling Agent Guardrails and Retry Patterns September 2026

Blog

September 17, 2026

6 Open Source AI Gateways Ranked for September 2026

Blog

September 17, 2026

Red-Team Your LLM: Attack Vectors & Evidence (September 2026)

Blog

September 17, 2026

LLM Gateway: Routing, Enforcement, and Compliance (September 2026)

Governance

September 17, 2026

What Is an LLM Proxy? Production Routing & Enforcement (September 2026)

Compliance

September 17, 2026

Production LLM Security for CISOs (September 2026)

AI agents

September 17, 2026

AI Incident Response for Model Failures (September 2026)

Blog

September 17, 2026

Ship AI Faster With Governance Gates (September 2026)

Governance

September 17, 2026

Continuous AI Risk Monitoring: Beyond Snapshots (September 2026)

AI evals

September 17, 2026

How to Red-Team AI Models Effectively (September 2026)

Compliance

September 17, 2026

High-Risk AI Drift Detection and Compliance Monitoring (September 2026)

Compliance

September 16, 2026

EU AI Act, NIST AI RMF & ISO 42001 Compliance Together (September 2026)

Observability

September 16, 2026

LLM Jailbreak Red Teaming & Defense Guide September 2026

Governance

September 8, 2026

Tiering AI Systems: Internal Risk Classification (August 2026)

AI evals

September 8, 2026

AI Risk Assessment Report for Auditors (August 2026)

AI agents

August 18, 2026

Agentic AI Risk: Evaluating Autonomous Systems Aug 2026

Blog

August 5, 2026

GPAI Documentation Requirements Every Provider Needs (August 2026)

Compliance

August 5, 2026

Audit-Ready by Default: Continuous Evidence August 2026

Blog

August 5, 2026

AI Compliance Toolkit: Governance, Audit Evidence & Enforcement August 2026

Compliance

August 5, 2026

Continuous AI Compliance: Automating the Evidence Burden (July 2026)

AI

July 28, 2026

SR 26-2 Explained: 2026 Model Risk Management Updates for AI

Compliance

July 28, 2026

EU AI Act Credit Scoring High-Risk System Guide (July 2026)

Compliance

July 28, 2026

EU AI Act Credit Scoring High-Risk System Guide (July 2026)

AI evals

July 28, 2026

NAIC AI Model Bulletin: What Insurers Must Prepare for in July 2026

Compliance

July 28, 2026

Fair Lending AI Compliance: Credit Model Bias Testing (July 2026)

Blog

July 21, 2026

Enterprise LLMOps Platforms: Top 7 in July 2026

Blog

July 21, 2026

AI Hallucinations: Types, Causes & Prevention (July 2026)

Blog

July 21, 2026

Build vs. Buy AI Governance: How to Decide (July 2026)

Blog

July 21, 2026

LLM Evaluation in Regulated Sectors (July 2026)

Blog

July 21, 2026

6 Top AI Governance Tools for Financial Services (July 2026)

Blog

July 21, 2026

What Is an AI Control Plane? (July 2026)

Blog

July 21, 2026

Leading Fiddler AI Alternatives & Competitors July 2026

Blog

July 21, 2026

Governing Shadow AI in Your Organization (July 2026)

Blog

July 21, 2026

AI Agent Observability Guide: Tracing Actions & Tool Calls (July 2026)

Blog

July 21, 2026

AI Agent Failure Modes: Tool-Calling Errors, Infinite Loops & Propagation (July 2026)

Compliance

July 21, 2026

Model Validation for LLMs and Agents: SR 11-7 (July 2026)

Observability

July 21, 2026

AI Monitoring vs AI Observability: Stack Implications Explained (July 2026)

AI evals

July 21, 2026

Quantify and Prioritize AI System Risk with Scoring (July 2026)

Governance

July 21, 2026

Third-Party AI Risk Management and Vendor Governance (July 2026)

Blog

July 21, 2026

High-Risk AI Model Evaluation Guide (July 2026)

Blog

July 21, 2026

Audit Evidence From LLM Traces (July 2026)

Blog

July 21, 2026

Best OneTrust AI Governance Alternative in July 2026

Blog

July 21, 2026

AI Governance for Insurance: Risk Management July 2026

Blog

July 21, 2026

LLM Behavior Visualization: Traces to Team Signals (July 2026)

Blog

July 21, 2026

Production AI Hallucination Detection (July 2026)

Blog

July 21, 2026

Custom LLM Scorer Design Without the Three-Week Trap (July 2026)

Blog

July 21, 2026

CI/CD Evaluation Gates: Block Merges When Models Fail (July 2026)

Blog

July 21, 2026

How to Benchmark Embedding Models for Your Use Case (July 2026)

Testing

July 13, 2026

OWASP LLM Security Testing: Top 10 Risks Guide (July 2026)

Governance

July 13, 2026

Governing Copilot Studio, Agentforce & Low-Code AI (July 2026)

Compliance

July 13, 2026

PII Detection in LLM Outputs: AI Team Guide (July 2026)

AI evals

July 13, 2026

RAG Evaluation in Production: Groundedness, Faithfulness, and Retrieval Quality (July 2026)

Governance

June 29, 2026

Production Agent Governance Guide (June 2026)

AI

June 29, 2026

How Runtime AI Controls Differ from Documentation (June 2026)

Governance

June 25, 2026

AI Governance Best Practices: A Framework for Enterprise Leaders in June 2026

Data science

June 25, 2026

AI Fairness Metrics: A Complete Guide for Enterprise ML Teams in June 2026

AI

June 17, 2026

AI Governance for Healthcare: A Complete Framework for June 2026

AI agents

June 17, 2026

AI Model Audit: A Complete Guide for June 2026

Governance

June 17, 2026

Responsible AI Framework: Principles and Implementation Guide for June 2026

Compliance

June 17, 2026

ISO 42001: A Complete Guide to AI Management Systems in June 2026

Development

June 3, 2026

What is AI governance? A complete guide for May 2026

Compliance

June 3, 2026

EU AI Act limited risk AI systems: compliance requirements in May 2026

Governance

June 3, 2026

Best AI governance software platforms in May 2026

Governance

June 2, 2026

The 6 best AI governance tools in May 2026

Governance

June 2, 2026

AI Model Governance Frameworks for Enterprise Teams in May 2026

Governance

June 2, 2026

AI Governance vs Data Governance: What's the Difference in May 2026

AI evals

June 2, 2026

OpenAI evals: A complete guide to evaluation frameworks in March 2026

Compliance

May 13, 2026

EU AI Act timeline: Key compliance deadlines for May 2026

Compliance

May 13, 2026

EU AI Act obligations for providers vs deployers: complete guide for May 2026

Compliance

May 13, 2026

EU AI Act for financial services: implementation guide for May 2026

Compliance

May 13, 2026

EU AI Act prohibited practices: complete compliance guide for May 2026

Compliance

April 30, 2026

NIST AI RMF Implementation Guide (April 2026)

Compliance

April 30, 2026

EU AI Act transparency obligations: complete compliance guide for April 2026

Compliance

April 24, 2026

EU AI Act post-market monitoring requirements: complete compliance guide for April 2026

Compliance

April 24, 2026

EU AI Act risk management system requirements: April 2026 guide

Compliance

April 16, 2026

EU AI Act technical documentation requirements: Complete guide for April 2026

Compliance

April 16, 2026

High-risk AI systems under the EU AI Act: A complete guide for April 2026

Compliance

April 6, 2026

EU AI Act compliance checklist: 10 steps for high-risk AI systems in April 2026

Compliance

April 6, 2026

EU AI Act conformity assessment: Requirements and process guide for April 2026

AI evals

March 30, 2026

LLM-as-judge: A complete guide to evaluation best practices in March 2026

Model quality

March 30, 2026

Model monitoring in 2026: A complete guide for ML teams

AI evals

March 27, 2026

LLM evaluation metrics: Complete guide for March 2026

Data science

March 27, 2026

RMSE formula: complete guide to root mean square error calculation in March 2026

March 25, 2026

Openlayer and Telefónica Tech partner to bring AI governance and observability to enterprise scale

AI agents

March 9, 2026

Multi-agent system architecture: a comparison guide + best practices (March 2026)

AI evals

March 9, 2026

Agent evaluation: Complete guide to testing AI agents in March 2026

Machine learning

March 9, 2026

What are embedding models? A complete guide for March 2026

Machine learning

March 9, 2026

Binary Cross Entropy: a complete guide for machine learning engineers (March 2026)

Observability

February 25, 2026

10 best LLM observability tools to know in February 2026

Observability

February 25, 2026

LLM observability: complete guide to monitoring AI applications in February 2026

Company

February 18, 2026

Openlayer recognized in the 2026 Gartner® Market Guide for AI Evaluation and Observability Platforms

Machine learning

February 18, 2026

False positive rate explained: a complete guide for ML teams (February 2026)

AI agents

February 18, 2026

Agent testing in February 2026: your complete guide to validating AI systems

Compliance

February 11, 2026

CSRD reporting: complete guide for February 2026

AI evals

February 11, 2026

RAG Groundedness Evaluation Guide (Feb 2026)

Data science

February 11, 2026

KS Score: Considerations for AI Model Evaluation

AI evals

January 29, 2026

Needle in a Haystack: AI Testing Guide (Jan 2026)

Machine learning

January 25, 2026

Precision and Recall in Machine Learning (Jan 2026)

Model quality

January 20, 2026

MAPE (Mean Absolute Percentage Error): complete guide in January 2026

Model quality

January 13, 2026

ROC Curves & AUC: Complete Guide (February 2026)

Model quality

January 13, 2026

F1 Score: Precision-Recall Balance - January 2026

Pricing

January 5, 2026

Credo AI reviews, pricing, and alternatives (January 2026)

Pricing

January 5, 2026

MLflow reviews, pricing, and alternatives (January 2026)

Guardrails

January 5, 2026

AI guardrails: the complete guide for LLMs in January 2026

AI evals

January 2, 2026

Galileo reviews, pricing, and alternatives (January 2026)

Compliance

December 22, 2025

Best AI compliance tools for regulatory requirements (December 2025)

AI evals

December 22, 2025

Best AI drift detection tools for production models (December 2025)

Pricing

December 22, 2025

Deepchecks reviews, pricing, and alternatives (December 2025)

Pricing

December 22, 2025

IBM WatsonX reviews, pricing, and alternatives (December 2025)

Observability

December 22, 2025

Braintrust reviews, pricing, and alternatives (December 2025)

Observability

December 15, 2025

Best AI governance platforms for enterprise security (December 2025)

Observability

December 11, 2025

Best Real-Time AI Security Guardrails (December 2025)

AI

December 11, 2025

Best Multimodal AI Testing Platforms (Dec 2025)

AI

December 11, 2025

Best AI evaluation platforms for LLM testing (December 2025 update)

AI

December 9, 2025

Best AI observability tools for production monitoring (December 2025)

Testing

November 25, 2025

Best AI Agent Evaluation Platforms (Feb 2026)

August 21, 2025

Introducing our brand new UI, smarter testing, and faster data connections

New hires

June 23, 2025

Emmett Nelson joins Openlayer as Account Executive

New hires

May 29, 2025

Welcoming Luciano Rolim as our new Head of GTM LatAm!

Observability

May 20, 2025

How to prevent prompt injection

Company

May 14, 2025

We’ve Raised a $14.5M Series A to Build the AI Reliability Platform

Company

April 15, 2025

The Openlayer MCP server

Observability

February 24, 2025

AI Observability Explained: February 2026

Company

October 16, 2024

Constitutional AI for All

Testing

February 23, 2024

Evaluating RAG pipelines with Ragas and Openlayer

Company

November 29, 2023

Navigating the chaos: why you don’t need another MLOps tool

Data-centric

November 23, 2023

What is data-centric AI, and 3 reasons to pay attention to it

Explainability

November 1, 2023

SHAP demystified: understand what Shapley values are and how they work

Error analysis

August 15, 2023

Error analysis x Model monitoring: how are they different?

Error analysis

July 10, 2023

Error Analysis in ML: Beyond Predictive Performance

Data quality

June 26, 2023

Data labeling and relabeling in machine learning

Data science

June 20, 2023

Detecting data integrity issues in machine learning

Data science

June 13, 2023

How to generate synthetic data for machine learning projects

Model quality

June 5, 2023

Baseline models demystified: a practical guide

Explainability

May 23, 2023

Evaluating ML Models Beyond Aggregate Metrics

Machine learning

May 16, 2023

How LIME works | Understanding in 5 steps

Company

May 4, 2023

Openlayer raises $4.8m seed round to build guardrails for AI

Data science

March 14, 2023

The importance of model versioning in machine learning

Company

June 28, 2022

The race to put AI to work

Data science

June 22, 2022

Why every company needs citizen data scientists

Data science

May 25, 2022

Surefire ways to identify data drift

Model quality

May 23, 2022

Debugging models with the bias-variance trade-off

Machine learning

May 19, 2022

Understanding each piece in the ML infrastructure stack

Company

May 17, 2022

Openlayer named to the 2022 CB Insights AI 100 list of most innovative startups

Explainability

May 11, 2022

The roads toward explainability

Model quality

April 25, 2022

Understanding and measuring data quality

Machine learning

April 21, 2022

Ensemble learning 101

Data science

April 18, 2022

The challenge of becoming a full-stack data scientist

Machine learning

April 13, 2022

The representation of meaning

Big data

April 11, 2022

10 examples of using Python for big data analysis

Machine learning

April 5, 2022

Mental models for ML products

Explainability

March 31, 2022

Anchor your predictions

Machine learning

March 28, 2022

Dealing with class imbalance, continued

Machine learning

March 22, 2022

Dealing with class imbalance

Explainability

March 15, 2022

3 differences between ML in production and in academia

Model quality

March 10, 2022

Testing and its many guises

Machine learning

February 22, 2022

Model evaluation in machine learning

Company

February 17, 2022

Building the future of ML

Work on the future.