AW3
Agile Development Concurrent Session
11/12/2014 11:30 AM
"Shifting Left: The Evolution of
Test Automation"
Presented by:
Jennifer Bonine and Michael Faulise
tap | QA
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Jennifer Bonine is a VP of global delivery and solutions for tap|QA,
Inc., a global company that specializes in strategic solutions for
businesses. Jennifer began her career in consulting, implementing
large ERP solutions. She has held executive level positions leading
development, quality assurance and testing, organizational
development, and process improvement teams for Fortune 500
companies in several domains. In a recent engagement for one of
the world’s largest technology companies, Jennifer served as a
strategy executive and in corporate marketing for the C-Suite. In her
career, she has had several opportunities to build global teams from
the ground up and has been fortunate to see how many of the
world’s top companies operate from the C-Suite viewpoint.
Michael Faulise is the founder and managing partner at tap|QA,
LLC, a global company that specializes in quality solutions for
businesses. Mike focuses on sales and delivery where he consults
with clients in the areas of leading development, quality assurance
and testing, technology and process training, and process
improvement. He has seen software development evolve along the
multiple paths of various methodologies but has found quality has
remained essentially constant.
Continuous Integration
April 2014
tap|QA Presentation
2
Agenda
Overview
What is involved?
Mobile
Skill Sets
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Continuous Integration
3
Solutions Focus Pays
Success StoriesOur Mission
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
tap|OVERVIEW
Focus Pays
Client Examples
 Our mission is to provide our clients with focused solutions
for delivering Strategic and Tactical Quality Initiatives
 We pride ourselves on hiring highly talented people that
deliver high quality work for our Clients
Why tap|QA?
 Our investment in our employees has allowed us to meet the
growing demand or QA roles. Including the new Technologies and
Business Requirements every QA now has along with the desire
and drive in Quality.
 Our innovation has created new approaches in competing with Off-
shore models with our tap|Lakeshore. Our tap|Technology team is
advancing leading edge ideas in Continuous Integration, Delivery
and Deployment.
4
Continuous Integration – The practice of
everyone involved with code, merging their
local copies multiple times a day.
Attempting to prevent Deployment Delays
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Continuous Integration
5
Continuous Delivery – The automated process of
implementing, validating and reporting code from
development to production. But only moving into
Production after passing a manual quality gate.
Continuous Deployment – The automated process of
implementing, validating and reporting code from
development to production.
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Delivery Vs. Deployment
6
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Continuous Integration Cont.
7
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Traditional Vs. CI Automation
UI
Automation:
QTP
Selenui
m
Load Testing:
LoadRunn
er
Jmeter
UI
Automation:
QTP
Selenui
m
Load Testing:
Loadrunne
r
Jmeter
Expanded
Harness:
Jmeter
CodedUI
Test Harness:
Junit
SoapUI
8
Local Developer Level:
Unit tests (TDD)
Execute in < 30 seconds
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
What is Involved ?
9
QA Takes ownership of Test Harness:
Enhance and Expand Test Harness
Adding Code
Additional Test Scenarios
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Where QA is Involved ?
10
CI Implementation at Development Master:
Unit, Smoke, and Core Functionality tests
Adding Code
Additional Test Scenarios
Jmeter, SoapUI, Visual Studio, TFS, etc.
Execute in < 2 minutes
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Where QA is Involved Cont.
11
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Deployment Management
12
QA Level
Smoke, Expanded Core Functionality, and UI tests
QTP, Selenium, Jmeter, SoapUI, TFS, etc.
Execute in < 2 – 4 hours
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Where QA is Involved Cont.
13
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Where QA is Involved Cont.
Stage Level
Smoke, Complete Core functionality, Full UI, and Load
tests
LoadRunner, Jmeter, LoadUI, etc.
Execute in < 6 – 12 hours
14
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Mobile
Mobile
Replicate all harnesses across all supported platforms
Windows 8 (C#)
Android (Java)
IOS (objectiveC)
15
Technical skills:
Architect level – Work with systems architect
designing CI automated processes, and implement of
initial automation framework POC.
Automation Engineer – Expansion of automation
coverage and maintenance of framework.
Non-Technical:
QA Analyst– Requirement decomposition, writing of
test scenarios, reviewing of failed executions.
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Skill Sets
16
Trend:
Current Requirements – Since CI is heavily integrated
within technology the teams are attempted to be
built with QA Analysts that have Architect and
Automation Skills.
Solutions Focus Pays
Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com
Observations
Quality
Assurance
Business
Industry
Technology
Questions?
Continuous Integration

More Related Content

PDF
An Introduction to Scaled Agile Framework (SAFe)
PDF
Be agile. Scale up. Stay Lean with SAFe by Michael Stump
PDF
Tech Talk: The New CA Application Performance Management Team Center—Faster T...
PDF
Adaptive Delivery at Scale With the Scaled Agile Framework (SAFe)
PDF
Moving to Open-Source Tools - How to Increase Performance Test Coverage Throu...
PDF
Understand SAFe in 8 Pictures
PPTX
Foundations of the Scaled Agile Framework 3.0
PDF
Scaling Scaled Agile: Lessons Learned at UnitedHealth Group
An Introduction to Scaled Agile Framework (SAFe)
Be agile. Scale up. Stay Lean with SAFe by Michael Stump
Tech Talk: The New CA Application Performance Management Team Center—Faster T...
Adaptive Delivery at Scale With the Scaled Agile Framework (SAFe)
Moving to Open-Source Tools - How to Increase Performance Test Coverage Throu...
Understand SAFe in 8 Pictures
Foundations of the Scaled Agile Framework 3.0
Scaling Scaled Agile: Lessons Learned at UnitedHealth Group

What's hot (20)

DOCX
Jacques+g+official+cv+05 07-2016
PDF
They Told Me to “Be Agile”, but I’m Not a Developer
PPTX
Modelling QA Transformation with Prime
PDF
Webinar On Scaled Agile Framework (SAFe) | iZenBridge
PDF
Hands-On Lab: Take CA Release Automation for a Test Drive
PDF
TechTalk: Reduce Risk with Canary Deployments
PDF
Removing the Friction Between Project and Portfolio Management and Agile
PDF
BCS Elite - March 2014 - v3
PDF
Slides
PDF
Moving from Load Runner to Open Source: Increase Performance Test Coverage 10...
PDF
Jonny Wooldridge InternetRetailing 2015
PPTX
Pango Journey to an Agile Cloud by Yaniv Kalo
PPTX
Realtech us dev_ops4sap_webinar_slides_06302020
PPTX
Can you do DevOps in SAP (SAP -> DevOps)
PDF
CA - Entrega Continua
PPTX
Harmonic's Journey Scaled-Agile In The New Generation of Cable OS v4
PDF
Leading the Transformation: Stories from the Trenches
PDF
Top Reasons Why Identity Management Projects Fail & How to Avoid Them
PDF
Technology Primer: Explore What's New in CA Application Performance Managemen...
PPSX
Agile Network India | Understanding the importance of a full featured CI/CD p...
Jacques+g+official+cv+05 07-2016
They Told Me to “Be Agile”, but I’m Not a Developer
Modelling QA Transformation with Prime
Webinar On Scaled Agile Framework (SAFe) | iZenBridge
Hands-On Lab: Take CA Release Automation for a Test Drive
TechTalk: Reduce Risk with Canary Deployments
Removing the Friction Between Project and Portfolio Management and Agile
BCS Elite - March 2014 - v3
Slides
Moving from Load Runner to Open Source: Increase Performance Test Coverage 10...
Jonny Wooldridge InternetRetailing 2015
Pango Journey to an Agile Cloud by Yaniv Kalo
Realtech us dev_ops4sap_webinar_slides_06302020
Can you do DevOps in SAP (SAP -> DevOps)
CA - Entrega Continua
Harmonic's Journey Scaled-Agile In The New Generation of Cable OS v4
Leading the Transformation: Stories from the Trenches
Top Reasons Why Identity Management Projects Fail & How to Avoid Them
Technology Primer: Explore What's New in CA Application Performance Managemen...
Agile Network India | Understanding the importance of a full featured CI/CD p...
Ad

Viewers also liked (9)

PDF
Risk-Based Testing for Agile Projects
PDF
Automate REST API Testing
PDF
Ambiguity Reviews: Building Quality Requirements
PDF
Putting Quality First through Continuous Testing
PDF
Continuous Testing through Service Virtualization
PDF
Shift Left Mobile Application Testing
PPTX
Shifting Left Webinar Slideshow
PDF
The Journey to Continuous Testing
PDF
Shift Left - Approach and practices with IBM
Risk-Based Testing for Agile Projects
Automate REST API Testing
Ambiguity Reviews: Building Quality Requirements
Putting Quality First through Continuous Testing
Continuous Testing through Service Virtualization
Shift Left Mobile Application Testing
Shifting Left Webinar Slideshow
The Journey to Continuous Testing
Shift Left - Approach and practices with IBM
Ad

Similar to Shifting Left: The Evolution of Test Automation (20)

PPT
SOASTA Webinar: Process Compression For Mobile App Dev 120612
PPTX
Test Automation in Agile
PPTX
Mobile App Quality Roadmap for DevTest Teams
PPTX
QA in an agile world Tom Churchwell
PDF
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
PPTX
Zero touch QA automation platform for DevOps
PPTX
Brave New World - A wider perspective of our opportunities
PDF
Keynote StarEast - Testing in the Fast Lane (Transformation)
PDF
High Performance Software Engineering Teams
PPTX
Stop manual testing: Take your weekends back!
PDF
Test Automation: Investment Today Pays Back Tomorrow
PDF
The Road to QA
PPTX
Test automation and beyond developing an effective continuous test strategy d...
PDF
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
PDF
Case Study : Manual & Automation Testing
PDF
UiPath Test Automation using UiPath Test Suite series, part 1
PDF
A Better, Faster Pipeline for Software Delivery
PDF
Continuous Quality: DevOps with Quality by Josh Eastman
PDF
Transform Test Organizations for the New World of DevOps
PPTX
5 Stages of Digital Quality Maturity
SOASTA Webinar: Process Compression For Mobile App Dev 120612
Test Automation in Agile
Mobile App Quality Roadmap for DevTest Teams
QA in an agile world Tom Churchwell
Test Automation using UiPath Test Suite - Developer Circle Part-1.pdf
Zero touch QA automation platform for DevOps
Brave New World - A wider perspective of our opportunities
Keynote StarEast - Testing in the Fast Lane (Transformation)
High Performance Software Engineering Teams
Stop manual testing: Take your weekends back!
Test Automation: Investment Today Pays Back Tomorrow
The Road to QA
Test automation and beyond developing an effective continuous test strategy d...
Agile Testing Transformation is as Easy as 1, 2, 3 by Michael Buening
Case Study : Manual & Automation Testing
UiPath Test Automation using UiPath Test Suite series, part 1
A Better, Faster Pipeline for Software Delivery
Continuous Quality: DevOps with Quality by Josh Eastman
Transform Test Organizations for the New World of DevOps
5 Stages of Digital Quality Maturity

More from TechWell (20)

PDF
Failing and Recovering
PDF
Instill a DevOps Testing Culture in Your Team and Organization
PDF
Test Design for Fully Automated Build Architecture
PDF
System-Level Test Automation: Ensuring a Good Start
PDF
Build Your Mobile App Quality and Test Strategy
PDF
Testing Transformation: The Art and Science for Success
PDF
Implement BDD with Cucumber and SpecFlow
PDF
Develop WebDriver Automated Tests—and Keep Your Sanity
PDF
Ma 15
PDF
Eliminate Cloud Waste with a Holistic DevOps Strategy
PDF
The Fourth Constraint in Project Delivery—Leadership
PDF
Resolve the Contradiction of Specialists within Agile Teams
PDF
Pin the Tail on the Metric: A Field-Tested Agile Game
PDF
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
PDF
A Business-First Approach to DevOps Implementation
PDF
Databases in a Continuous Integration/Delivery Process
PDF
Mobile Testing: What—and What Not—to Automate
PDF
Cultural Intelligence: A Key Skill for Success
PDF
Turn the Lights On: A Power Utility Company's Agile Transformation
PDF
Scale: The Most Hyped Term in Agile Development Today
Failing and Recovering
Instill a DevOps Testing Culture in Your Team and Organization
Test Design for Fully Automated Build Architecture
System-Level Test Automation: Ensuring a Good Start
Build Your Mobile App Quality and Test Strategy
Testing Transformation: The Art and Science for Success
Implement BDD with Cucumber and SpecFlow
Develop WebDriver Automated Tests—and Keep Your Sanity
Ma 15
Eliminate Cloud Waste with a Holistic DevOps Strategy
The Fourth Constraint in Project Delivery—Leadership
Resolve the Contradiction of Specialists within Agile Teams
Pin the Tail on the Metric: A Field-Tested Agile Game
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
A Business-First Approach to DevOps Implementation
Databases in a Continuous Integration/Delivery Process
Mobile Testing: What—and What Not—to Automate
Cultural Intelligence: A Key Skill for Success
Turn the Lights On: A Power Utility Company's Agile Transformation
Scale: The Most Hyped Term in Agile Development Today

Recently uploaded (20)

PDF
DOWNLOAD—IOBit Uninstaller Pro Crack Download Free
PPTX
Beige and Black Minimalist Project Deck Presentation (1).pptx
PPTX
ESDS_SAP Application Cloud Offerings.pptx
PPTX
Phoenix Marketo User Group: Building Nurtures that Work for Your Audience. An...
PDF
Top AI Tools for Project Managers: My 2025 AI Stack
PDF
MaterialX Virtual Town Hall - August 2025
PDF
OpenAssetIO Virtual Town Hall - August 2025.pdf
PDF
Mobile App for Guard Tour and Reporting.pdf
PPTX
Post-Migration Optimization Playbook: Getting the Most Out of Your New Adobe ...
PPTX
Presentation - Summer Internship at Samatrix.io_template_2.pptx
PDF
Science is Not Enough SPLC2009 Richard P. Gabriel
PPTX
Lesson-3-Operation-System-Support.pptx-I
PDF
Ragic Data Security Overview: Certifications, Compliance, and Network Safegua...
PPTX
MCP empowers AI Agents from Zero to Production
PPTX
Greedy best-first search algorithm always selects the path which appears best...
PPTX
Independent Consultants’ Biggest Challenges in ERP Projects – and How Apagen ...
PDF
OpenEXR Virtual Town Hall - August 2025
PDF
Enscape 3D Crack + With 2025 Activation Key free
PDF
IObit Driver Booster Pro Crack Latest Version Download
PPTX
SAP Business AI_L1 Overview_EXTERNAL.pptx
DOWNLOAD—IOBit Uninstaller Pro Crack Download Free
Beige and Black Minimalist Project Deck Presentation (1).pptx
ESDS_SAP Application Cloud Offerings.pptx
Phoenix Marketo User Group: Building Nurtures that Work for Your Audience. An...
Top AI Tools for Project Managers: My 2025 AI Stack
MaterialX Virtual Town Hall - August 2025
OpenAssetIO Virtual Town Hall - August 2025.pdf
Mobile App for Guard Tour and Reporting.pdf
Post-Migration Optimization Playbook: Getting the Most Out of Your New Adobe ...
Presentation - Summer Internship at Samatrix.io_template_2.pptx
Science is Not Enough SPLC2009 Richard P. Gabriel
Lesson-3-Operation-System-Support.pptx-I
Ragic Data Security Overview: Certifications, Compliance, and Network Safegua...
MCP empowers AI Agents from Zero to Production
Greedy best-first search algorithm always selects the path which appears best...
Independent Consultants’ Biggest Challenges in ERP Projects – and How Apagen ...
OpenEXR Virtual Town Hall - August 2025
Enscape 3D Crack + With 2025 Activation Key free
IObit Driver Booster Pro Crack Latest Version Download
SAP Business AI_L1 Overview_EXTERNAL.pptx

Shifting Left: The Evolution of Test Automation

  • 1. AW3 Agile Development Concurrent Session 11/12/2014 11:30 AM "Shifting Left: The Evolution of Test Automation" Presented by: Jennifer Bonine and Michael Faulise tap | QA Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
  • 2. Jennifer Bonine is a VP of global delivery and solutions for tap|QA, Inc., a global company that specializes in strategic solutions for businesses. Jennifer began her career in consulting, implementing large ERP solutions. She has held executive level positions leading development, quality assurance and testing, organizational development, and process improvement teams for Fortune 500 companies in several domains. In a recent engagement for one of the world’s largest technology companies, Jennifer served as a strategy executive and in corporate marketing for the C-Suite. In her career, she has had several opportunities to build global teams from the ground up and has been fortunate to see how many of the world’s top companies operate from the C-Suite viewpoint. Michael Faulise is the founder and managing partner at tap|QA, LLC, a global company that specializes in quality solutions for businesses. Mike focuses on sales and delivery where he consults with clients in the areas of leading development, quality assurance and testing, technology and process training, and process improvement. He has seen software development evolve along the multiple paths of various methodologies but has found quality has remained essentially constant.
  • 4. 2 Agenda Overview What is involved? Mobile Skill Sets Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Continuous Integration
  • 5. 3 Solutions Focus Pays Success StoriesOur Mission Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com tap|OVERVIEW Focus Pays Client Examples  Our mission is to provide our clients with focused solutions for delivering Strategic and Tactical Quality Initiatives  We pride ourselves on hiring highly talented people that deliver high quality work for our Clients Why tap|QA?  Our investment in our employees has allowed us to meet the growing demand or QA roles. Including the new Technologies and Business Requirements every QA now has along with the desire and drive in Quality.  Our innovation has created new approaches in competing with Off- shore models with our tap|Lakeshore. Our tap|Technology team is advancing leading edge ideas in Continuous Integration, Delivery and Deployment.
  • 6. 4 Continuous Integration – The practice of everyone involved with code, merging their local copies multiple times a day. Attempting to prevent Deployment Delays Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Continuous Integration
  • 7. 5 Continuous Delivery – The automated process of implementing, validating and reporting code from development to production. But only moving into Production after passing a manual quality gate. Continuous Deployment – The automated process of implementing, validating and reporting code from development to production. Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Delivery Vs. Deployment
  • 8. 6 Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Continuous Integration Cont.
  • 9. 7 Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Traditional Vs. CI Automation UI Automation: QTP Selenui m Load Testing: LoadRunn er Jmeter UI Automation: QTP Selenui m Load Testing: Loadrunne r Jmeter Expanded Harness: Jmeter CodedUI Test Harness: Junit SoapUI
  • 10. 8 Local Developer Level: Unit tests (TDD) Execute in < 30 seconds Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com What is Involved ?
  • 11. 9 QA Takes ownership of Test Harness: Enhance and Expand Test Harness Adding Code Additional Test Scenarios Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Where QA is Involved ?
  • 12. 10 CI Implementation at Development Master: Unit, Smoke, and Core Functionality tests Adding Code Additional Test Scenarios Jmeter, SoapUI, Visual Studio, TFS, etc. Execute in < 2 minutes Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Where QA is Involved Cont.
  • 13. 11 Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Deployment Management
  • 14. 12 QA Level Smoke, Expanded Core Functionality, and UI tests QTP, Selenium, Jmeter, SoapUI, TFS, etc. Execute in < 2 – 4 hours Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Where QA is Involved Cont.
  • 15. 13 Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Where QA is Involved Cont. Stage Level Smoke, Complete Core functionality, Full UI, and Load tests LoadRunner, Jmeter, LoadUI, etc. Execute in < 6 – 12 hours
  • 16. 14 Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Mobile Mobile Replicate all harnesses across all supported platforms Windows 8 (C#) Android (Java) IOS (objectiveC)
  • 17. 15 Technical skills: Architect level – Work with systems architect designing CI automated processes, and implement of initial automation framework POC. Automation Engineer – Expansion of automation coverage and maintenance of framework. Non-Technical: QA Analyst– Requirement decomposition, writing of test scenarios, reviewing of failed executions. Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Skill Sets
  • 18. 16 Trend: Current Requirements – Since CI is heavily integrated within technology the teams are attempted to be built with QA Analysts that have Architect and Automation Skills. Solutions Focus Pays Copyright © 2014 TAP/QA, LLC – Confidential & Proprietary. For more information: www.tapQA.com Observations Quality Assurance Business Industry Technology