What Is A Test Strategy?
What Is A Test Strategy?
Error Analysis - When Correcting the error , ask these three questions :
- Is the cause of the bug reproduced in another program?
- What “next bug” might be introduced by the fix that I’m
about to make?
- What could we have done to prevent this bug in the first place?
Debugging
Error Analysis - When Correcting the error , ask these three questions :
- Is the cause of the bug reproduced in another program?
- What “next bug” might be introduced by the fix that I’m
about to make?
- What could we have done to prevent this bug in the first place?
Testing Metrics
Test Case Adequacy
• Test Case Adequacy = No. of actual Test cases * 100 / No. of
test cases estimated
Test Case Effectiveness
• Test Case Effectiveness = # of defects detected using the test
cases * 100/ total # of defects detected in testing
Defect Detection Index
• Defect Detection Index = # of defects detected in each phase
/ total # of defects planned to be detected in each phase
Metrics
• Why Measure
Tracking Projects against plan
Take timely corrective actions
Getting early warnings
Basis for setting benchmarks
Basis for driving process improvements
Tracking process performance against business
objectives
Testing Metrics
Test Case Adequacy
• Test Case Adequacy = No. of actual Test cases * 100 / No. of
test cases estimated
Test Case Effectiveness
• Test Case Effectiveness = # of defects detected using the test
cases * 100/ total # of defects detected in testing
Defect Detection Index
• Defect Detection Index = # of defects detected in each phase
/ total # of defects planned to be detected in each phase
Testing Metrics
Defect Density
• Total Defect density = (Total number of defects found in all
the phases + Post delivery defects)/Size
Average Defect Age
• Average Defect age = (Sum of ((Defect detection phase
number – defect injection phase number) * No of defects
detected in the defect detection phase))/(Total Number of
defects till date)
Defect Removal Efficiency
• DRE = 100 * No. of pre-delivery defects / Total No. of Defects
Testing Metrics
Review Effectiveness
• Review Effectiveness = 100 * Total no. of defects fond in
review / Total no. of defects
Cost of finding a defect in review(CFDR)
• Cost of finding a defect in reviews = (Total efforts spent on
reviews / No. of defects found in reviews)
Cost of finding a defect in testing(CFDT)
• Cost of finding a defect in testing = (Total efforts spent on
testing / defects found in testing)
Testing Metrics
Cost of Quality
• % Cost of Quality = (Total efforts spent on Prevention + Total
efforts spent on Appraisal + Total efforts spent on failure or
rework)*100/(Total efforts spent on project)