For Banks The Ai Reckoning Is Here May 2025
For Banks The Ai Reckoning Is Here May 2025
AI IN FI REPORT 2025
11 Act Now
Introduction
AI is moving fast—but Yet BCG analysis finds that only a quarter of financial
institutions are using AI to reinforce their competitive position.
most banks aren’t keeping The rest are experimenting at the margins—understandable,
but insufficient. Winning in the coming era will require far
up where it matters.
more than isolated pilots or cautious upgrades. It means
anchoring AI strategy in business strategy, systematically
prioritizing high-ROI use cases, embedding clear performance
metrics, and mobilizing capital and CEO leadership decisively
Predictive AI has been reshaping financial services for toward scalable impact—with tight alignment between
years, pushing banks to fend off digital competitors and investment and results.
rethink their own operations. But the arrival of GenAI is
an inflection point—accelerating AI’s impact, raising AI presents a strategic fault line. The banking leaders
new strategic questions, and amplifying both opportunities that are acting now—defining where they will compete and
and risks. Agentic AI—systems that can act how they will win—have already begun to shape the
autonomously within set parameters—propels this shift industry’s future. The rest will be shaped by it.
even further by moving AI from analysis into execution.
• AI-driven transparency will expose rate structures, Fee-based transactional services will also face pressure.
fees, and lending terms in real time, eroding pricing AI-powered payment networks and embedded finance
power based on opacity. Banks will increasingly need players will pull more volume into ecosystems outside the
to compete on financial value—offering transparent traditional banking framework, forcing banks to rethink
pricing—as well as intangible value: the timeliness and their role in the value chain.
quality of their advice and how well they understand and
anticipate customer needs. Caution is costing time. Despite broad enthusiasm,
many banks remain wary of AI, particularly GenAI, and its
• AI-led financial decision making is shifting control current limitations, including its ethical and responsible
from banks to digital platforms that act as financial use. Large language models (LLMs) can “fantasize”—that
gatekeepers. GenAI is a hyper-accelerant in this is, generate non-factual output—when not tightly
evolution—enabling more autonomous, seamless, and controlled. They can also struggle with real-time data
personalized experiences that pull activity away from feeds, a critical gap in some financial applications. These
traditional banking channels. Agentic AI will amplify concerns have encouraged some banks to tread cautiously.
these changes, making it even harder for banks to own
the customer relationship. Investment levels reflect this hesitation. BCG’s AI Radar
found that one in three companies plans to spend over $25
million on AI in 2025, and some will spend in the range of
0.5% to 1% of revenues. But too much of this funding is
going toward isolated productivity improvements rather
than broader transformation. (See Exhibit 1.) Such
AI-led financial decision making investments suggest that many banks are still playing it
safe rather than positioning AI as a competitive
is shifting control from banks differentiator. In addition, while they are enthusiastic about
to digital platforms that act as AI’s potential, 60% of banks haven’t defined financial
performance indicators to track impact. Without clear
financial gatekeepers. metrics to ensure ongoing strategic alignment, they won’t
generate the ROI they need.
Invent
company-level innovations
27 core to the business
Deploy
initiatives focused on 44
individual productivity
Reshape
29 critical functions by improving
process-level productivity
broader transformation. The window to get ready for these changes is closing.
Within the next few years, and certainly by the end of the
decade, the banking landscape will look fundamentally
different. Leaders need to be modeling what this shift
means for their institutions—and defining the role they
intend to play in it.
prepare the organization. Equipped with those insights, banks can then consider
their strategic positioning and ask themselves, “Where can
we secure defendable advantage in the medium term?”
Three general models are emerging: the utility provider
focused on operational efficiency, the open-architecture
bank curating personalized financial products, and the
financial marketplace connecting customers with diverse
financial services. (See Exhibit 2.)
Put AI at the center of tech and data. Making AI work • Data availability, not just accuracy, defines AI
at scale requires rethinking the architecture itself. This performance. Most AI failures in banking aren’t
demands changes across tech, data, and infrastructure: about the models—they’re about slow, incomplete,
or fragmented data. Unlocking AI’s full potential
• Workflow integration requires deep orchestration. requires addressing outdated systems and IT shortcuts
As banks evolve their AI capabilities, the challenge has (often referred to as technical debt), setting up strong
shifted from developing specialized models to integrating governance, and enabling efficient data integration
them intelligently. Orchestration matters, and GenAI across cloud and on-premise environments. LLMs
makes this nonnegotiable. (See Exhibit 3.) Banks will take a central role in banking AI, but they won’t
must design routing mechanisms that direct specific be sufficient. Many financial tasks are simply too
information to the best-fit model while also integrating specialized to rely on broad, general-purpose models,
proprietary data through techniques like retrieval- even when these are customized for particular domains.
augmented generation (RAG) and domain-specific small The use of purpose-built SLMs trained on specific data
language models (SLMs). Orchestration will become even for targeted GenAI applications will be key. Platforms
more critical as agentic AI use expands so that banks and orchestration systems that can optimize the use of
can coordinate decision execution as well as information LLMs and SLMs across AI-driven functions—bridging
flows. Responsible AI governance must also become current data silos—will also be needed.
integrated. Today, AI models are typically reviewed
individually by internal watchdogs. But as financial
institutions develop increasingly complex ecosystems—
with dozens or even hundreds of interconnected and
potentially autonomous models—banks will need holistic
oversight. This includes robust frameworks to stress-test
model interactions, identify emergent risks, and manage
intricate system interdependencies.
Logging &
Model platform Feature store Model hosting/activation
monitoring Security Integration
Data products
Specialized hardware
Infra and Cloud Layer Public cloud Private cloud
(GPU, TPU)
• Core layers must modernize. Most banking systems • Hybrid infrastructure is essential. Today, AI systems
are a technological patchwork that obstructs the dynamic, can flag risks, surface insights, and suggest pricing
real-time, and unstructured capabilities essential for changes—but most don’t trigger real-time adjustments.
innovative AI applications. Simply adding AI components This must change. There are many opportunities where
to existing infrastructure won’t work. Leading institutions predictive and agentic AI can work together to propose
are demonstrating a new approach. Commonwealth Bank an action and then implement it without exposing the
of Australia, for example, has implemented an event- bank to risk. Fully personalized marketing interactions
driven architecture and an AI-powered transaction core. are one example. For these opportunities to expand,
These allow for real-time fraud detection and response, infrastructure needs to be hybrid. It must cut across
contributing to a 50% drop in scam losses and a 30% on-premise, cloud, and edge environments to enable
decrease in customer-reported fraud. high degrees of modularity and the widespread use of
application programming interfaces and micro-services.
Early engagement with regulators will be key to managing Some banks are exploring solutions. JPMorgan Chase has
the direction of this journey. For now, however, uncertainty implemented a GenAI tool called LLM Suite, accessible to
remains the biggest drag on AI adoption in finance. In our 200,000 employees, including CEO Jamie Dimon. The bank
research, 61% of institutions cite regulation as a top offers training programs and leverages superusers to assist
concern. But waiting for clarity isn’t a strategy. Indeed, colleagues in integrating AI tools into their workflows.
most supervisory authorities are looking for banks to BBVA has partnered with the University of Navarra to
engage with them and uncover areas where effective AI launch a training initiative targeting over 150 top
regulation can remove barriers to growth. managers. This program focuses on the use of GenAI to
improve executives’ productivity by optimizing their
strategic decision making and daily operations.
now will define the next is clear. Here are three steps they should take this year:
generation of leaders.
• Systematically evaluate where AI can drive ROI.
High-value use cases exist across every bank function
from operations to wealth management. Assessments
Success will depend on should drill into the numbers, denoting expected value
and cost as well as the underlying assumptions. Include
a disciplined approach: qualitative benefits as well, such as faster processes,
better insights, and a better user experience.
focusing AI on measurable • Connect use cases to processes. Use case selection
into decision making, and organization. This mindset is the key to scaling—and
allows organizations to see impact faster and build it
Saurabh Tripathi is a managing director and senior Stiene Riemer is a managing director and partner in
partner in Boston Consulting Group’s Mumbai office and BCG's Munich office and the global lead for AI
global leader of the Financial Institutions practice. He can developments in financial institutions. You can reach her
be reached at [email protected]. at [email protected].
Matteo Coppola is a managing director and senior Kirsten Rulf is an associate director and partner in the
partner in the firm’s Milan office and global practice leader firm’s Berlin office and a core member of the Technology
for Risk and Compliance. You can reach him at and Digital Advantage practice. You can reach her at
[email protected]. [email protected].
Jürgen Rogg is a managing director and senior partner in Christian Schmid is a managing director and senior
BCG’s Zurich office and global leader of the Digital and partner in BCG's Zurich office and a core member of BCG's
Technology in Financial Institutions topic. You can reach Public Sector, Financial Institutions, and Technology
him at [email protected]. Advantage practices. You may contact him by email at
[email protected].
Michael Strauß is a managing director and senior partner For Further Contact
in the firm’s Cologne office and leads BCG's Financial
Institutions practice in Central Europe and GenAI in Europe. If you would like to discuss this report, please contact
You can reach him at [email protected]. the authors.