Business Intelligence Training Deck
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 2
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 3
What is Business Intelligence?
Business intelligence (BI) is a broad category of applications and technologies for gathering, storing, analyzing, and providing access to data to help enterprise users make better business decisions.
BI applications include the activities of decision support systems, query and reporting, online analytical processing (OLAP), statistical analysis, forecasting, and data mining.
BI Testing Services | Testing Center of Excellence 4
Inputs to Business Intelligence
BI Testing Services | Testing Center of Excellence 5
Basics(elements) of BI
BI Testing Services | Testing Center of Excellence 6
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 7
Why BI Testing needed?
Data, its flow and its transformation in Business Intelligence Systems need to be carefully validated due to increasing reliance of Senior Executives across organizations, in all sectors, on this data to make data driven decisions which have significant impact on organizations. Importance The success of business decisions depends on the quality of underlying information It is difficult to obtain an Integrated view of the important dimensions of business to monitor, track and improve business performance Due to rapidly changing business environment, decisions may need to be based on near-real time data accuracy of data is very important Business Intelligence is essential for organizations that believe in adapting quickly to market changes and customer requirements and helps in modifying business rules according to the changing conditions. Effects of BI Testing Simpler faster cost-effective implementation Analytical mechanisms that enabled faster and more insightful decision-making Leads to improved efficiencies Improved Usability due to Integration Adapting quickly to changing business needs Cycle time is more
BI Testing Services | Testing Center of Excellence 8
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 9
How BI Testing is Different
BI Testing differs from testing of operational systems on several accounts. The key areas are described in this section below,
CHALLENGES in Business Intelligence Testing
Multiple, abstract sub-systems Sources Data Integration Extract, Match, Validate, Cleanse, Complete, Conform Data Structures Staging, ODS, EDW, Marts Presentation semantic layer, information delivery Multiple technologies & vendors RDBMS, ETL, Data Quality, MDM, Metadata Mgmt, Analytics & Reporting Interactive user interfaces to view data Data processed via backend data feeds BI systems not only need to be tested for validity of data processing as per business rules, but also for robust Data Integration & Reporting processes Extremely high, batch oriented Data processing BI Process Information presentation
Business Analysis
Complex Data Architecture
Technologies
Interfaces
I M P A C T
Organization Decisions
Data & BI Process Centric High Data Volumes Multiple Focus Areas
Strategic Planning
BI Testing Services | Testing Center of Excellence 10
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 11
Basic Skill set for BI Tester
Knowledge of SQL. Basic knowledge of UNIX Understanding of Data warehouse concepts Knowledge of ETL processes and tool Knowledge of Reporting tool Basic knowledge of marketing, sales, purchase and finance processes to understand the business needs
BI Testing Services | Testing Center of Excellence 12
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Introduction to Data warehouse Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 13
Business Intelligence Workflow
Any tool, process or activity that can be used for obtaining the best information of supporting the decisionmaking process.
BI Testing Services | Testing Center of Excellence 14
BI Testing Approach
BI Testing Services | Testing Center of Excellence 15
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 16
Data Warehouse
A Data warehouse is a central repository of data which is created by integrating data from one or more disparate sources. Data warehouses store current as well as historical data and are used for creating trending reports for senior management reporting such as annual and quarterly comparisons.
BI Testing Services | Testing Center of Excellence 17
Important characteristics
Subject oriented Integrated Time- variant Non-volatile
BI Testing Services | Testing Center of Excellence 18
Data Warehouse Process Flow
BI Testing Services | Testing Center of Excellence 19
Data Marts
A data mart is a simple form of a data warehouse that is focused on a single subject (or functional area), such as Sales, Finance, or Marketing. Data marts are often built and controlled by a single department within an organization. Two types of Data Marts -Dependent -Independent
BI Testing Services | Testing Center of Excellence 20
Dependent Data marts
Top Down Approach or Dependent Data Marts (W.H.Inmon)
BI Testing Services | Testing Center of Excellence 21
Dependent Data marts
BI Testing Services | Testing Center of Excellence 22
Independent Data marts
Bottom-Up Approach or Independent Data Marts (Ralph Kimball)
BI Testing Services | Testing Center of Excellence 23
Independent Data marts
BI Testing Services | Testing Center of Excellence 24
BI Testing Services | Testing Center of Excellence 25
Data Warehouse - Dimensional Modeling Dimension Table
Dimension tables contain textual information that represents the attributes of the business Contain relatively static data Dimension tables are joined to a fact able through foreign key reference
Examples: Retail store name, zip code, product name, product category, day of week. Telecommunications -- call origin, call destination Banking customer name, account number, branch, account officer Insurance policy type, insured party
BI Testing Services | Testing Center of Excellence 26
Data Warehouse - Dimensional Modeling Fact Table
Contain numerical metrics of the business Can hold large volumes of data Can grow quickly
Examples: Retail number of units sold, sales amount Telecommunications Length of call in minutes, average number of calls Banking Average monthly balance
Insurance Claims amount
BI Testing Services | Testing Center of Excellence 27
Data Warehouse - Schemas
A schema is a collection of database objects, including tables, views, indexes, and synonyms. Data Warehouse environment usually transforms the relational data model into some special architectures. There are many schema models designed for data warehousing but the most commonly used are: Star Schema Snowflake Schema Fact constellation Schema Galaxy Schema
BI Testing Services | Testing Center of Excellence 28
Star Schema Example
BI Testing Services | Testing Center of Excellence 29
Snow Flake Schema Example
BI Testing Services | Testing Center of Excellence 30
Galaxy Schema Example
BI Testing Services | Testing Center of Excellence 31
Fact Constellation Schema Example
BI Testing Services | Testing Center of Excellence 32
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL test processes and scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 33
ETL Introduction
ETL is a process used to collect data from various sources, transform the data depending on business rules/needs and load the data into a destination database Extract, Transform, Load, this three database functions that are combined into one tool to pull data out of one database and place it into another database The process of updating the data warehouse.
BI Testing Services | Testing Center of Excellence 34
ETL Tools
Informatica - Power Center IBM - Web sphere Data Stage SAP - Business Objects Data Integrator AB Initio
BI Testing Services | Testing Center of Excellence 35
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 36
ETL TEST PROCESS - Data extraction
Purpose
To show that all source data, for every data specification, with all known data errors will be handled correctly
Scope
All data extraction programs to be tested on samples of all source data files Source data have been tested, have been analyzed Test extraction (and SA filling) for every source file Test extraction (and SA filling) for every source / domain spec. Check extraction (and SA-filling) for every data item Test every data item on boundary values, on coded values Test all validation output Test all counters and totaling options
Prerequisites Techniques and requirements
ETL
SA
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
BI Testing Services | Testing Center of Excellence 37
ETL TEST PROCESS Data transformation
Purpose
To show that all data transformation rules are implemented and do function as specified.
All data transformation programs to be tested against all transformation rules / specifications. Source data have been tested, have been analyzed Standard techniques to be applied for black box unit test Covering all data transformation rules as there are Coding and decoding of data values Consolidation of data records, production of totals Addition of linked data items
Scope
Prerequisites
Techniques and requirements
ETL
SA
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
BI Testing Services | Testing Center of Excellence 38
ETL TEST PROCESS Data loading
Purpose
To show that all data loading (in the data warehouse) will function undisturbed without errors, performing as required From (final) staging area to data warehouse itself. Staging area data are available in full size preferable with more than one increment, in order to test for linearity Well require performance requirements in full Performance testing techniques and analysis tools to be used
Scope
ETL SA
Prerequisites
Techniques and requirements
SA ETL
SA
DM BI
Queries
DM
BI
OLAP Reporting
SA ETL DWH DM BI
Data mining
BI Testing Services | Testing Center of Excellence 39
ETL Test Scenario
Data insertion as per source target mapping sheet - Correctness of data based on transformation rules - Data types, length of source and targets - Duplicate data - Data loss - Data Quality Update of data as per defined update strategy Delete/Close scenarios as per defined strategy Data accuracy Metadata testing Scripts/Power jobs execution and dependencies
BI Testing Services | Testing Center of Excellence 40
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 41
Introduction to Reporting
Business intelligence reporting describe the practice of analyzing large amounts of data in the form of human readable format. Reports are summaries or collections of information about an aspect of an organizations business. They contain views of the current data in your organizations database, organized and formatted the way you want. You can use two types of data sources when creating reports: detailed and summary.
BI Testing Services | Testing Center of Excellence
42
BI Reporting tool architecture
BI Testing Services | Testing Center of Excellence 43
Reporting Process
BI Testing Services | Testing Center of Excellence 44
Reporting Tools
Business Objects Cognos BI Crystal Reports Micro Strategy Oracle Reports
BI Testing Services | Testing Center of Excellence 45
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 46
Reporting test scenarios
Prompt Type of prompt Description of prompt Default selection Values in prompt Search of value in prompt Minimum and Maximum selection Mandatory prompts Report Label and Headings Layout and Graphs Measures/Metrics Correctness of Data Page by and sorting Drilling Export
BI Testing Services | Testing Center of Excellence 47
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 48
Trust BI Methodology
DELIVER Project Delivery Methodology
Inception
Requirement Gathering Solution Definition Functionality Matrix Architecture
Elaboration
Use Cases, Technical Design, Data Model, Report Specification, ETL Mapping, ETL Process
Construction
Database Objects, ETL, Reports
Transition
Deployment Production Support & Maintenance
TrustBI Methodology
Initiate & Plan
Knowledge Acquisition Process Understand Requirements, Architecture, Testing Scope, Success Criteria, Risks Test cycles & alignment with SDLC Test Data Mgmt requirements Test Environment Requirements
Design
Test Plan & Cases objective, prerequisite, expected results UAT Performance Module Integration Tests Base line regression tests Test Data Mgmt Profile Test Data Source Test data slice size, frequency, periodicity Test env. privileges
Prepare
Setup test environment Scripts / procedures to mask & copy test data (from production) Profile data for test case fulfillment Scripts / procedures to create / procure missing test data Create SQL & associate data sets & expected results for test cases
Execute
Run test procedures for new code Identify impact on existing code and run regression tests Record results
Evaluate
Conduct severity and causal analysis Raise Change Requests, if required Log results
The TrustBI Methodology is based on our proven TMap methodology The focus is on Business & Risk driven testing Test Intensity & Test Data Mgmt are directly proportional to the project risks that are required to be mitigated
Activities
Test Project Plan Test Strategy
Scope Test Data Mgmt Test environment mgmt Defect management Change management Configuration mgmt. Test metrics & reporting Standards & Tools
Deliverables
UAT plans & cases Performance Testing plans & cases SIT plan & cases Module Testing plan & cases Test Data Mgmt plan Test data volumes to be used Test data refresh approach Test data masking algorithms Test data creation process
Test Environment Test Data Test Data creation scripts Test Cases associated test scripts, test data and expected results
Test results Defect logs
Test results severity & root cause Change Requests
BI Testing Services | Testing Center of Excellence 49
Contents
Business Intelligence overview Why BI testing is needed How BI is different from other testing Basic Skill set for BI tester Business Intelligence workflow Data warehouse and Data marts Introduction of ETL ETL Test processes and Scenarios Introduction to Reporting Reporting test scenarios Trust BI Methodology Sample test cases
BI Testing Services | Testing Center of Excellence 50
Sample test cases
ETL Sample test cases as below -Inserted later on Reporting test cases as below -Inserted later on
BI Testing Services | Testing Center of Excellence 51
Q&A
BI Testing Services | Testing Center of Excellence 52
Thank You
BI Testing Services | Testing Center of Excellence 53
