The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems

@article{Steinmetz2025TheTC,
  title={The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems},
  author={Scott Steinmetz and Asmeret Bier Naugle and Paul Schutte and Matthew D. Sweitzer and Alex Washburne and Lisa Linville and Daniel Krofcheck and Michal Kucer and Samuel Myren},
  journal={ArXiv},
  year={2025},
  volume={abs/2503.15511},
  url={https://api.semanticscholar.org/CorpusID:277151155}
}
The Trust Calibration Maturity Model (TCMM) is proposed and demonstrated on two target tasks: using ChatGPT for high consequence nuclear science determinations, and using PhaseNet (an ensemble of seismic models) for categorizing sources of seismic events.
[PDF] Semantic Reader

Figures and Tables from this paper

3 Citations

A Maslow-Inspired Hierarchy of Engagement with AI Model

The Hierarchy of Engagement with AI model is introduced, a novel maturity framework inspired by Maslow's hierarchy of needs that demonstrates that AI maturity progression is multi-dimensional, requiring technological capability, ethical integrity, organisational resilience, and ecosystem collaboration.

Multicalibration in Fair Link Prediction

This work provides a novel formulation of multicalibration fairness metric for graph-structured data, specifically for the task of link prediction, and defines a simple quadratic program-based postprocessing method for this purpose.

Balancing Minds and Data: The Privacy Dilemma of LLMs and Anthropomorphism in LLMs

70 References

Towards Defining a Trustworthy Artificial Intelligence System Development Maturity Model

This study seeks to define a trustworthy AI system development maturity model to assist firms in understanding where they stand in terms of developing a trustworthy AI platform and includes a maturity model with four stages of trustworthy AI system growth and maturity progression.

A Maturity Model for Trustworthy AI Software Development

A maturity model for ensuring trustworthy and reliable AI software, known as AI-MM, is proposed, by considering common AI processes and fairness-specific processes within a traditional maturity model, SPICE (ISO/IEC 15504).

A Naturalistic Investigation of Trust, AI, and Intelligence Work

It is found that trust in AI is often affected by the interaction of other people with the AI, and that involving end users in the development of the AI also affects trust, demonstrating that trust is a multifaceted phenomenon.

Trusting Automation: Designing for Responsivity and Resilience

A relational framing of trust based on the decision situation, semiotics, interaction sequence, and strategy can guide future trust research and design for automation responsivity and more resilient human-automation systems.

Independent High-Level Expert Group on Artificial Intelligence)

It is argued that extant accounts of trustworthiness in the philosophy literature cannot make proper sense of trustworthy AI and that the account developed here compares favourably with its competitors on this front.

Extending Three Existing Models to Analysis of Trust in Automation: Signal Detection, Statistical Parameter Estimation, and Model-Based Control

    T. Sheridan
    Engineering, Computer Science
    Hum. Factors
  • 2019
This research shows how three existing models, namely those for signal detection, statistical parameter estimation calibration, and internal model-based control, can be revised and reinterpreted to apply to trust in automation useful for human–system interaction design.

Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI

This work discusses a model of trust inspired by, but not identical to, interpersonal trust as defined by sociologists, and incorporates a formalization of 'contractual trust', such that trust between a user and an AI model is trust that some implicit or explicit contract will hold.

Trust, transparency, explanation, and planning: Why we need a lifecycle perspective on human-automation interaction

This chapter argues viewing trust formation as “mental model reconciliation” claiming that this viewpoint unifies and explains many observed methods for trust calibration and shows the utility of “displacing” transparency information away from execution and into pre- and postmission intervals where humans have more capacity to calibrate trust.

Predictive Capability Maturity Model for computational modeling and simulation.

The Predictive Capability Maturity Model is a new model that can be used to assess the level of maturity of computational modeling and simulation (M&S) efforts and is a structured method for assessing the maturity of an M&S effort that is directed toward an engineering applicationmore » of interest.

How model accuracy and explanation fidelity influence user trust

It is found that accuracy is more important for user trust than explainability, and that users cannot be tricked by high-fidelity explanations into having trust for a bad classifier.
...