Chart The Course For Responsible AI Governance
Chart The Course For Responsible AI Governance
Contents
Foreword3 Part Three
- Data Integration 13
- Data Quality and Observability 13
- Data Bias 14
- Data Privacy 14
informatica.com 2
Chart the Course for Responsible AI Governance
Foreword
AI technology has rapidly moved from the edge of the adoption curve
to mainstream interest. This pace of change can be unsettling for
many enterprises, especially as they grapple with the reality of using
AI effectively and responsibly.
informatica.com 3
Chart the Course for Responsible AI Governance
Introduction
Redefining Business With Generative AI problems of bottlenecked data pipelines, data quality issues and
insufficient data management strategies. They will use GenAI as a
˝Generative AI (GenAI) is fundamentally changing the way we interact forcing function, taking long-needed actions to streamline, observe and
with technology — and the world. It is the fulcrum that businesses rely control their processes for managing multi-structured data.3
on to enhance, empower, and engage employees and customers. ̏¹
2024 has seen this AI evolution rapidly expand across many enterprises.
In the latest McKinsey Global Survey on AI, 65% of respondents report Organizations will need to demonstrate how they are
that their organizations regularly use GenAI. Looking ahead, most using AI safely and responsibly and be able to easily
respondents — 67 percent — expect their organizations to invest more in
answer why their AI models have made certain decisions.
AI over the next three years.2
informatica.com 4
Chart the Course for Responsible AI Governance
informatica.com 5
Chart the Course for Responsible AI Governance
Srividya Sridharan
VP and Group Research Director at Forrester
informatica.com 6
Chart the Course for Responsible AI Governance
Part One
4 https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai
5 https://artificialintelligenceact.eu/documents/#:~:text=The%20AI%20Act%20will%20likely,between%20late%202024%20–%20summer%202027.
6 https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai
informatica.com 7
Chart the Course for Responsible AI Governance
The Act categorizes AI systems based on their risk to rights and safety.7
The Act defines the following:
7 https://www.artificial-intelligence-act.com/#:~:text='Artificial%20intelligence%20system'%20
(AI,logic%2D%20and%20knowledge%20based%20approaches%2C
informatica.com 8
Chart the Course for Responsible AI Governance
Beyond EU Boundaries The proposed framework aims to create a trusted environment for
Understanding how to comply with the organizational requirements AI development globally, emphasizing principles like explainability,
of the EU AI Act naturally extends to operating in the market with both transparency and fairness.9
customers and competitors. As such, the impact of this new legislation Singapore’s AI governance framework emphasizes responsible and
will be felt beyond EU boundaries due to the global nature of the digital ethical AI development. The key principles are:
economy. It states, “The aim of the new rules is to foster trustworthy AI
in Europe and beyond by ensuring that AI systems respect fundamental 1. Transparency, Explainability and Fairness: Decisions made by AI
rights, safety and ethical principles and by addressing risks of very systems should be transparent, explainable and fair. This ensures that
powerful and impactful AI models.”8 users understand how AI arrives at its conclusions.
Therefore, the EU AI Act can compel non-EU countries and companies 2. Human-Centric Approach: AI solutions should prioritize human well-
to evaluate and potentially adjust their AI strategies and services if they being and safety. They should amplify human capabilities rather than
wish to operate in the EU market. This approach could standardize replace them.10
controls across regions, enabling some organizations to gain a
“Good governance is crucial. With the right guard rails in place, we create
competitive edge by aligning better with regulations and managing
conditions to innovate safely, responsibly and for a common purpose.
international partnerships more harmoniously. These far-reaching
The borderless nature of tech also means this must be a shared
implications reaffirm the importance of understanding and engaging with
endeavor,” said Deputy Prime Minister Heng Swee Keat. Singapore has
international regulations in an increasingly complex world. (You can read
recognized the global nature of AI innovation in enterprise usage and
more in the article here).
the need to work together across countries and regions to manage AI
regulatory compliance.
Singapore Model AI Governance Framework
The framework identifies nine areas — including accountability, trusted
Model AI Governance Framework for Generative AI: Singapore has
data for AI training and content provenance — where the governance of
developed a proposed framework for generative AI, which expands on
generative AI can be strengthened.
the existing Model Governance Framework that covers traditional AI.
8 https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai
9 https://www.imda.gov.sg/resources/press-releases-factsheets-and-speeches/press-releases/2024/public-consult-model-ai-governance-framework-genai
¹0 https://www.pdpc.gov.sg/help-and-resources/2020/01/model-ai-governance-framework
informatica.com 9
Chart the Course for Responsible AI Governance
U.S. Executive Order on AI There are seven AI-related bills in the California legislature,
Biden’s “Executive Order on the Safe, Secure and Trustworthy demonstrating the growing patchwork of U.S. state AI laws.
Development and Use of Artificial Intelligence”11 was published on Oct Research shows that efforts to regulate AI appear to be growing rapidly.
30, 2023. It provided U.S. government-authored guidance on eight Stanford University's 2023 AI Index shows that 37 AI-related bills were
primary sections: passed into law globally in 2022, with countries such as Canada, India,
y New Standards for AI Safety and Security China and Switzerland all developing AI regulations.12
y Protecting Americans’ Privacy As illustrated here, many countries are in various stages of evolution in
regulating AI and have differing views of how best to do it. Consequently,
y Advancing Equity and Civil Rights
there is no clear consensus on how best to regulate AI either from
y Standing Up for Consumers, Patients and Students a global standpoint or consistently, which allows innovation while
y Supporting Workers curtailing potentially harmful uses of AI.
y Promoting Innovation and Competition As EMEA Informatica Chief Architect, Siddharth Rajagopal analyzes the
global landscape, and he predicts, “We will likely see a divergence in
y Advancing American Leadership Abroad
how countries across the globe regulate AI. This could look like different
y Ensuring Responsible and Effective Government Use of AI variants of the same regulations that are loosely based on the EU AI Act.
The order is an initial step to ensure that AI is trustworthy and helpful. But large, multi-national organizations will not be able to afford to do
It aims to guide how AI is developed so that companies can profit AI regulation on a siloed project-by-project, country-by-country basis. It
without jeopardizing public safety. (You can read more about it in is too complex.” Rajagopal further emphasizes the need for a strategic
an article here.) approach, stating, “Instead, they will need to consider how AI regulation
translates into policy and put solid foundations in place that can be
Other Regulations in Focus easily adapted for individual regions. For example, regulators across
countries are showing an appetite for transparency.”
In May 2024, the Colorado Artificial Intelligence Act (CAIA) became law
in the U.S., making Colorado the first state to enact legislation governing
the use of high-risk artificial intelligence systems.
¹¹ https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/
¹² https://hai.stanford.edu/news/2023-state-ai-14-charts
informatica.com 10
Chart the Course for Responsible AI Governance
Develop a detailed risk management framework that addresses the specific exposure
associated with unreliable AI and data management practices or unknowns (e.g., user
access rights).
Establish and communicate clear data and AI policies regarding data usage, AI model
deployment and regulatory compliance.
informatica.com 11
Chart the Course for Responsible AI Governance
Part Two
Challenges in AI Governance
Many companies today have inefficient data management
processes that result from disorganized pipelines, inadequate data
observability and a lack of governance controls. These perennial
problems can make generative AI outputs unfit for use, which could
lead to poor decisions, frustrated customers and significant policy
compliance violations.
Let’s take a closer look at these capabilities and how they support
modern data governance.
informatica.com 12
Chart the Course for Responsible AI Governance
informatica.com 13
Chart the Course for Responsible AI Governance
Data Bias This leads to ethical considerations of how to manage data responsibly,
ensuring data is handled according to defined ethical factors such
as transparency, fairness and bias when applying data management
policies for appropriate use.
“The danger with AI is that it is designed to work at
scale, making huge numbers of predictions based on Data Privacy
vast amounts of data. Because of this, the effect of just
Data leaders surveyed in our CDO Insights 2024 survey are seeing
a small amount of bias present in either the data or the
roadblocks in AI governance. A notable 35% revealed ‘The inability
algorithms can quickly be magnified exponentially.” 15 to minimize risks related to industry regulations and compliance laws,17
Bernard Marr which could be complicating their frustration with their inability
Futurist Author, Keynote Speaker and Strategic Business Advisor to manage access to private and sensitive data (33%).18 Moreover,
45% saw data privacy and protection as a top data management
investment priority.
32% of CDOs in our Informatica “CDO Insights 2024: Charting a Course The lack of oversight in data privacy and protection can pose
to AI Readiness” survey saw bias as a top challenge in adopting or a more significant challenge and lead to a loss of trust in AI
planning to adopt GenAI technology.16 adoption, for example, when using personally identifiable information
(PII) inappropriately.
Bias can come in different forms, such as:
Enabling security controls while allowing data access for various
1. Statistical bias, which includes data and algorithmic bias. qualified teams and roles is a critical challenge in AI and data
2. Societal bias, which encompasses human and business bias that management, especially for maintaining compliance with security
policies. It's important to clarify data ownership and establish rights for
could be codified into business policies. Such biases can have severe
proper data use. Data should be managed with a clear understanding of
implications. Training AI systems on incomplete or biased data can
who owns or produces it, and how it should be used appropriately. It's
lead to incorrect patterns and, in turn, make incorrect predictions
crucial to provide data only to those who need it and are aligned to
or develop hallucinations — where AI systems generate false or
the data strategy, while respecting data ownership and use policies.
distorted outputs — resulting in incorrect or misleading results.
¹5 https://bernardmarr.com/building-responsible-ai-how-to-combat-bias-and-promote-equity/
¹6 CDO Insights 2024: Charting a Course to AI Readiness
¹7 Ibid.
¹8 Ibid.
informatica.com 14
Chart the Course for Responsible AI Governance
AI offers tremendous promise for data management potential, but aligning an entire organization
behind it will become increasingly difficult as data leaders contend with multiple priorities as well
as multiple roadblocks.
The need for a single consolidated solution to manage all this data becomes abundantly clear.
Relying on existing staff to upskill or reskill to manage AI, as 48% of data leaders from the
CDO Insights 2024 survey19 would consider, can allow them to make strides in achieving their
AI and data goals — but that won’t be enough without providing these employees with the
proper technology.
Audit existing data management practices by regularly reviewing and refining data
management processes to eliminate inefficiencies and disorganized data pipelines.
Upskill employees and provide data literacy programs. Consider rolling out continuous
education focusing on AI and data literacy for relevant staff. (You can read more about
how Informatica supports data literacy programs here).
Develop training programs on bias mitigation and data ethics for employees.
informatica.com 15
Chart the Course for Responsible AI Governance
Part Three
Principles of Responsible AI
Ethical frameworks are crucial to understand in order to guide AI development and deployment. Principles of responsible AI, listed below, provide
some guidelines to explain what it means from our perspective. This foundation is vital for building sustainable AI practices that are compliant and
meet societal expectations.
informatica.com 16
Chart the Course for Responsible AI Governance
Governance establishes the frameworks, policies and standards to These principles help guide the creation and usage of AI technologies
manage AI development and deployment responsibly, focusing on that are beneficial for all stakeholders involved and are supportive of
ensuring compliance with ethical and legal standards. Data needs to general societal standards and values. They are at the center of building
be processed and made usable, trustworthy and democratized for use effective, robust data governance strategies and employing AI systems
across the organization, while adhering to governance policies. This that have been developed with the same goals (which we will discuss
should be flexible and adaptable to changing circumstances. further in the section on “Informatica’s AI Development Principles” for
product strategy).
informatica.com 17
Chart the Course for Responsible AI Governance
informatica.com 18
Chart the Course for Responsible AI Governance
Part Four
Informatica’s vision for data management is one of unification and empowerment. It encompasses a foundation enabling self-serve access to valid,
trustworthy data, with AI-infused tools amplifying productivity and enriching user experiences.20 Informatica Intelligent Data Management Cloud™
(IDMC) plays a central role in de-risking AI initiatives and enhancing compliance with regulations such as the EU AI Act. As shown in Figure 1, the
comprehensive solution offers data governance with privacy controls, data quality improvement and AI-powered data cataloging to ensure the
transparency, reliability and integrity of data. This is all done through a data management platform that is multi-vendor, multi-cloud (including AWS,
Azure and Google) and hybrid, supporting on-premises and cloud-based data storage and management. Through automated data management tasks
and seamless data integration, IDMC increases operational efficiency and creates a single source of truth.
Figure 1: Intelligent Data Management Cloud (IDMC) delivers what you need to achieve better business outcomes, all in one place.
informatica.com 19
Chart the Course for Responsible AI Governance
Leveraging CLAIRE®, Informatica’s unified metadata intelligence of 40 Increase Productivity Across the Organization
petabytes, introduces a natural language (NL)-based experience to
Improve quality and transparency of data by automating repetitive tasks
the IDMC. This dramatically simplifies tasks such as data discovery,
such as debugging, testing, refactoring and documentation. CLAIRE GPT
integration, quality, governance and master data management. The
helps data engineers quickly explore the datasets and find data quality
Informatica CLAIRE GPT, a generative AI-powered version of our
issues. It also helps document and test the pipeline.
pioneering AI engine CLAIRE, will enhance data management and data
utilization experience for all users. This rapidly improves a company’s Streamline Data Pipeline Creation With Fully Automated Workflows
time-to-value and amplifies business insights. Search and discover
CLAIRE GPT helps find the right datasets needed for the task directly
data assets are available in the data catalog through a natural language
from requirement specifications and generates the first draft of the data
interface powered by Informatica's large language model (LLM).
pipeline. CLAIRE GPT can create data mappings, data quality rules and
CLAIRE GPT helps simplify, accelerate and optimize data management
governance artifacts, thus allowing the data team to refine
operations, driving enormous gains in productivity for data teams.
them easily.
How IDMC Supports Responsible AI Governance These features enhance an already powerful Data Catalog as part
of IDMC. By harnessing CLAIRE's advanced machine learning and
Key benefits include:
AI capabilities, Data Catalog effectively ensures that data across
Empower Data Users and Reduce Data Management Costs the enterprise is consistently managed and compliant with relevant
regulations. Customers can automate the linkage of governance policies
CLAIRE GPT is a simple and easy-to-use interface. It allows more
directly to their enterprise data, ensuring that compliance (managing
business or citizen users to perform data management tasks without
relevant AI regulations) and best practices are embedded throughout
specialized knowledge, thus reducing the barrier to entry.
their data management processes (as illustrated in Figure 2 on
the next page).
informatica.com 20
Chart the Course for Responsible AI Governance
Figure 2: Example of an AI compliance dashboard from the Informatica Cloud Data Governance and Catalog, illustrating the management
of AI regulations.
This capability streamlines governance and enhances operational efficiency, allowing organizations to maintain a high standard of data integrity
and security without manual oversight. Organizations must have full trust and confidence in the applications they employ and be able to trace the
automation of data usage and governance from source to output.
informatica.com 21
Chart the Course for Responsible AI Governance
y Enhancing human productivity in data management: We aim to y Providing transparency and understandability: We aim to create
develop AI technologies for data management, making it easy for AI models that are effective and understandable. We will leverage
data teams and business users to manage their data effectively. By advanced interpretability frameworks and tools to provide insights
narrowing our focus, we aspire to deliver impactful solutions while into how our models make decisions, allowing users to understand,
tailoring our technologies to the unique needs and challenges within where appropriate, how our AI application reached its conclusions.
this area. y Designing delightful user experiences: We aim to harness AI to
y Ensuring data security and accountability: We pledge to create augment human productivity by crafting thoughtfully designed user
AI technologies that prioritize data privacy and security and experiences that delight end users.
balance them against the functionality of our product features. AI y Democratizing AI responsibly: We commit to making AI accessible
development oversight will include third-party audits, robust feedback to a broad range of users while maintaining a strong focus on ethical
mechanisms and a dedicated oversight team. We will maintain and privacy considerations. We will balance openness with robust
documentary evidence of how our AI was trained. This will help to control mechanisms designed to prevent misuse of technology and
ensure transparency in our processes and trust in our operations. protect data privacy.
(You can read more about Informatica’s vision in this blog article, “Designing a Principled Product Strategy for AI-Powered Data Management.”)
informatica.com 22
Chart the Course for Responsible AI Governance
21 https://www.mckinsey.com/~/media/mckinsey/business%20functions/mckinsey%20digital/our%20insights/the%20data%20dividend%20fueling%20generative%20ai/
the-data-dividend-fueling-generative-ai.pdf?shouldIndex=false
informatica.com 23
Chart the Course for Responsible AI Governance
informatica.com 24
Chart the Course for Responsible AI Governance
Success Stories
AI-Driven Data Unification in Telecom cross-functional use cases. Additionally, products, making them globally accessible
multiple governance standards across to partners and customers. Additionally,
A leading European multinational
different geographies and business entities Informatica has facilitated timely access to
telecommunication company faced a growing
contribute to operational inefficiencies. high-quality,
need to integrate diverse data sources
The company also faced continuous and cross-functional data, significantly
from various regions to responsibly cater to
escalating contractual and regulatory accelerating the transformation of the
different stakeholders and use cases. The
demands concerning the use of data and AI, end-to-end customer journey.
primary goal is to leverage data as a strategic
adding further complexity to its challenges.
asset across the enterprise to enhance
Outcomes:
business outcomes.
Solution: The implementation of Informatica's
Challenges: To address its data challenges, the solutions has led to readily available and
organization partnered with Informatica to trusted data, drastically reducing the time to
Navigating a vast and intricate data
implement a federated data governance realize business value. This enhancement
environment, characterized by over 1000
model. This model adheres to the FAIR in data accessibility and reliability has
enterprise applications, the organization had
principles, ensuring that data products also strengthened the organization’s
a critical need to govern diverse data
are findable, accessible, interoperable and adherence to contractual and regulatory
spanning enterprise networks and partners.
reusable. Informatica's solutions have compliance requirements, solidifying its
The company struggles with a scarcity of
empowered the company to democratize standing in a competitive and fast-evolving
reliable, reusable data assets that can support
high-quality, governed and secure data telecommunications industry.
Chart the Course for Responsible AI Governance
Conclusion
It is evident that using AI effectively requires a strategic approach 3. Appropriate Data Sharing – Enable responsible data and AI usage
to data governance coupled with compliance for evolving global with controls that align owners and producers to data and AI
regulations. According to Informatica’s CDO Insights 2024 Survey, consumption. This involves adopting data management practices
the top data strategy priorities for 2024 include delivering reliable that are transparent, fair and accountable, which are crucial for
and consistent data fit for generative AI (39%), improving data-driven maintaining public trust and meeting regulatory standards.
culture and data literacy (39%) and improving governance over data By leveraging the checklist in each section of this eBook,
and data processes (38%).22 These priorities all highlight the need to organizations can examine their readiness to adopt AI technologies
push beyond implementing and toward maximizing AI’s efficacy and across the business. These technologies support the delivery of
making the most of an organization’s investments. effective data governance using high-quality, compliant and
In summary, there are several key takeaways from this analysis: managed data.
1. Data and AI Governance for Regulatory Compliance – Have As AI and data management continue to advance, data leaders must
controls in place to map data strategy to mandates for appropriate recognize that they both go hand in hand, complementing each other
use policies, such as the new regulations like the EU AI Act. Staying to drive innovation. By harnessing their power collectively, leaders
ahead in regulatory compliance is crucial for enterprises to leverage can revolutionize their strategies and pave the way for transformative
new market opportunities without falling foul of regulatory non- progress within their organizations.
compliance, poor business decision-making, a tarnished reputation
and loss of customer trust.
2. Data Quality and Observability – Enhance the reliable performance
of data fueling GenAI and other applications such as analytics, by
providing transparency and explainability into how AI models use
data. This approach builds trust among users and holds entities
accountable for AI outcomes.
22 https://www.informatica.com/lp/cdo-insights-2024-charting-a-course-to-ai-readiness_4656.html
informatica.com 27
Chart the Course for Responsible AI Governance
Further Resources
Why AI-Powered Data Governance Helps Why AI-Powered Data Management Improves
Businesses Scale | Informatica GenAI Performance | Informatica
informatica.com 28
Chart the Course for Responsible AI Governance
About Us
Informatica (NYSE: INFA), a leader in enterprise AI-powered cloud data management,
brings data and AI to life by empowering businesses to realize the transformative power
of their most critical assets. We have created a new category of software, the Informatica
Intelligent Data Management Cloud™ (IDMC), powered by AI and an end-to-end data
management platform that connects, manages and unifies data across virtually any
multi-cloud, hybrid system, democratizing data and enabling enterprises to modernize
their business strategies. Customers in approximately 100 countries and more than
80 of the Fortune 100 rely on Informatica to drive data-led digital transformation.
Informatica. Where data and AI come to life.™
Worldwide Headquarters
2100 Seaport Blvd.
Redwood City, CA 94063, USA
Phone: 650.385.5000
Fax: 650.385.5500
Toll-free in the US: 1.800.653.3871
informatica.com
linkedin.com/company/informatica
x.com/Informatica
CONTACT US
IN19-5005-0924
© Copyright Informatica LLC 2024. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica LLC in the United
States and other countries. A current list of Informatica trademarks is available on the web at https://www.informatica.com/trademarks.html. Other
company and product names may be trade names or trademarks of their respective owners. The information in this documentation is subject to
change without notice and provided “AS IS” without warranty of any kind, express or implied.
informatica.com