Leveraging HP Performance Center
Download as PPTX, PDF6 likes4,989 views
Martin Spier and Rex Black presented on leveraging HP Performance Center at Expedia. Rex introduced himself as a performance consultant and Martin as a performance engineer at Expedia. They discussed how performance engineering aims to answer questions about an application's performance. Performance Center was highlighted as a tool that allows sharing resources across teams to improve efficiency and enable distributed testing. Expedia leverages Performance Center's centralized management and reusable test artifacts to test applications early and often across their global, agile teams.
More Related Content
![採用開源軟體打造企業資安監測系統 [2022/10/06] @InfoSec Taiwan 2022](https://cdn.slidesharecdn.com/ss_thumbnails/random-221006155126-27e1c84e-thumbnail.jpg?width=560&fit=bounds)
Similar to Leveraging HP Performance Center (20)
Leveraging HP Performance Center
- 1. Leveraging HP Performance Center Martin Spier (Expedia) Rex Black (J9)
- 2. Introductions Rex (Red) Black – Principal Consultant (J9) • Has worked with Load and Performance tools, processes and methodology for over 10 years • Works as a Performance Consultant & Instructor • Previous clients include: Dell, WalMart, ESPN and Expedia • Speaks at SQE & HP conferences on performance engineering topics • Formerly Manager of Performance Engineering at Expedia
- 3. Introductions Martin Spier – Performance Engineer, Expedia • 5+ years working with performance engineering tools, processes and methodologies • Currently part of the Expedia performance engineering team • Previously led a performance engineering team @ Dell • Writes (whenever possible) about performance engineering and related subjects on his blog (martinspier.co.uk)
- 4. Agenda • Performance Engineering • Performance Center • The Expedia Case
- 5. Performance Engineering Can I deploy my application to other regions? How much hardware do I need? Why is my application slow sometimes? Why is my application is intermittent? How many more users can I support? Can my application support X users and maintain a X second response time? If I patch that OS am I risking performance? My application is fast…but I have to reboot it periodically! What is the variance of my application’s performance?
- 6. Performance Engineering How can we answer all those questions?
- 7. Performance Engineering Definition “Performance engineering within systems engineering, encompasses the set of roles, skills, activities, practices, tools, and deliverables applied at every phase of the Systems Development Life Cycle which ensures that a solution will be designed, implemented, and operationally supported to meet the non-functional performance requirements defined for the solution.” Source: Wikipedia
- 8. Performance Engineering Questions What do you want to learn from your system? • How fast is it? • How does it scale? • Where does it break? What do you want to prove about your system? • Response times are X. • Thoughput is Y. • Scales to Z users.
- 9. Performance Engineering Activities Capacity and Performance Modeling Production Infrastructure Support Tuning Performance Engineering System Validation Benchmarking Testing Unit / Code Profiling Component and Performance Optimization Testing
- 10. Performance Engineering Key Performance Indicators • Responsiveness • Throughput • Stability • Scalability
- 11. Performance Engineering Types of Test • Load Testing is asserting how the architecture performs under load with a view to monitoring the response times for key transactions. • Stress Testing is asserting what the upper bounds are for the scalability of the architecture, understanding how it reacts when stressed. • Soak Testing is asserting that the performance of the architecture remains stable over longer periods of time.
- 12. Performance Engineering Methodology Execute and Analyze Prepare Tests Collect Results Metrics
- 13. Performance Engineering Tools • You will need tools to provide a meaningful performance assessment. • Even a simple stopwatch test will require a stopwatch. • The more complex your tests get, the better tools you will need to support them.
- 14. Performance Engineering Tools • Open Source – JMeter, Grinder, openSTA, loadUI • Commercial – Silk Performer, VSTS, LoadRunner, Performance Center • In-House Development
- 15. Performance Center “HP Performance Center is a suite of integrated performance testing solutions that can emulate hundreds or thousands of concurrent users to apply production workloads to virtually any environment; identify potential performance bottlenecks; and help diagnose and fix the root cause of the problems.” Source: Performance Center Brochure
- 16. Performance Center • LoadRunner – Standalone set of tools to prepare, execute and analyze performance tests – Supports a wide variety of protocols – Can collect metrics from a wide variety of systems • Performance Center – Centralized test environment – Web interface – Leverages capabilities of LoadRunner
- 18. Performance Center • Protocols – HTTP, WebService, FTP, RMI, LDAP, Citrix, MQ, Ajax ... – SQL Server, Oracle ... – Oracle EBS, SAP, Siebel, PeopleSoft ... • Monitors – Windows, Unix ... – WebLogic, IIS, Apache, SiteScope ... • Scripting Language – C, .NET, Java
- 19. Performance Center • Centralized repository – Scripts, test scenarios, results and reports – Versioning (new on PC 11) • Dedicated resource pools – Load generators and controllers • User management – Integrate with AD and LDAP • Organized by domain and project – Usage limits can be applied per project
- 20. Performance Center • Web interface – Create test scenarios – Setup system probes – Execute and monitor tests – View reports • Desktop clients – Connect to Performance Center server – Script development (VuGen) – Analysis
- 21. VuGen
- 22. Web Interface
- 23. Analysis
- 24. Expedia Environment • Multiple organizations inside the same company • Geographically dispersed teams (Global development) • Wide variety of technologies • Agile development • Continuous delivery (Weekly releases) • Pressure to reduce costs
- 25. Expedia Challenges • Reduce Costs – Efficient Use of Resources • Test Early and Often – Distributed Testing Capabilties • Don’t Reinvent the Wheel! – Avoid Custom Solutions for Each Team – Re-use Test Artifacts
- 26. Expedia Efficient Use of Resources Why? • Hardware and tools used for performance tests are usually high-end and expensive • Idle time is costly • Tool licensing costs are also expensive
- 27. Expedia Efficient Use of Resources How? • Sharing resources Timeslot reservation enables resources to be shared without creating an environment management nightmare. Resource pools and per project limits enable a fair share of resources to be distributed per team.
- 28. Expedia Efficient Use of Resources How? The hability of scheduling tests to executed in the future enable teams to • Test scheduling use precious resources even when no one is around 24/7 test coverage
- 29. Expedia Efficient Use of Resources How? • Leveraging software licenses License costs would be higher if each team had their own set of controller and virtual user licenses There is only one global limit for virtual users. Simple math, 26 independent teams would 26 controller licenses. Sharing resources enables teams to do the same thing, using less than half licenses for concurrent runs, just by reducing idle time. That’s economy of scale.
- 30. Expedia Efficient Use of Resources How? • Better capacity planning Centralized resource usage metrics serve as a great tool for capacity planning
- 31. Expedia Distributed Testing Capabilities Why? • Limited number of performance engineers • Increasing number of requests for early and frequent performance tests • Test earlier in the process • Execute small and more specialized tests
- 32. Expedia Distributed Testing Capabilities Support for a wide variety of protocols How? enable specialized tests such as database specific, web services, etc • Enabling non-performance engineering teams to participate A simple web interface enables non- performance egineering teams to execute and analyze simple tests
- 33. Expedia Avoid Custom Solutions Why? • Quickly and Easily Enable New Teams • Minimize Support
- 34. Expedia Avoid Custom Solutions How? • Single load test tool Central administration makes it easy to add new users, create new projects and set up new resource pools. Integration with LDAP/AD avoids the Flexibility and support for a wide variety of hassle of remembering another protocols and and systems enabled password. Performance Center to be a single solution capable of attending requirements from all teams. Less than ½ FTE is necessary to support the tool.
- 35. Expedia Re-Use Test Artifacts Why? • Be more productive • Spend less time on recurring tasks
- 36. Expedia Re-Use Test Artifacts How? • A Central Repository for Test Artifacts A central repository for scripts and scenarios with version control makes it easy to find and reuse test artifacts A single location for results and reports helps keeping track and comparing executions
- 37. Thank You! Martin Spier ([email protected]) Rex Black ([email protected])
- 38. Backup Slides
Editor's Notes
- #2: Add Revolutionizing Travel logo
- #30: Might remove the math from slide and only talk about it.10 independent controllers with 2000 vuser limit would have a max vuser limit of of 2,000.A shared instance of 10 concurrent runs with 2,000 vusers limit each would have a max vuser limit of 20,000.
- #33: % of tests executed by non-performance engineer resources