0% found this document useful (0 votes)
84 views15 pages

CRM Software Testing Challenges

A CASE STUDY OF AMAZON

Uploaded by

Miriam Mugure
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
84 views15 pages

CRM Software Testing Challenges

A CASE STUDY OF AMAZON

Uploaded by

Miriam Mugure
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 15

1

Case Study Analysis

Table of Contents

Executive Summary .................................................................................................................................... 2


Introduction ................................................................................................................................................. 3
Question 1: Nature of Customer Complaints and How to Address the Problem ................................. 3
Effects on Quality.................................................................................................................................... 3
Root Cause Analysis and Solutions ....................................................................................................... 4
Solutions ................................................................................................................................................... 5
Question 2: Which Problems Should ECL address on a priority basis ................................................. 5
Check Sheet ............................................................................................................................................. 5
Pareto Chart ............................................................................................................................................ 6
Question 3: Is the system testing process under control? ........................................................................ 7
Question 4: Is Network Latency a Significant Reason for underproductivity? .................................. 10
Question 5: Recommendations ................................................................................................................ 13
Conclusion ................................................................................................................................................. 14
2

Executive Summary

ECL aims to provide CRM software package to H&K. While the company has achieved notable progress,

they have also encountered some serious issues, such as customers' complaints. This has been during

the testing period. Partially, this shows the output and quality issues. Mainly, the problem is with the

productivity drop down as well as system test execution. This is mainly attributed to the fact that the

software has experienced delays in the deployment process by the software development team as well

as hardware and network lag. Elimination of the root causes or the improvement of the delivery and

testing can be achieved through a detailed investigation of the test cases statistics and response times

for the network. Fundamentally, the management at ECL is confronted with the problem of identifying

what is the main reason for the low productivity and consequently taking effective measures to improve

performance. The proposed solutions include the upgrading of the current equipment, the investment in

a robust network infrastructure as well as the automation of the process of the testing to make sure the

productivity is not affected.


3

Introduction

Exceed Communications LLC (ECL) is a technology-based enterprise, which was

launched in 2013 and provides customized solutions to clients based in the Middle East, Africa,

and South Asia. Famous for its solution-oriented approach and technological partnerships with

internationally known brands, ECL has become one of the fastest growing companies in the UAE.

In the first month of 2017, ECL with team size of 36 was working on the H&K project, a pioneer

in Real Estate as well as integrated business management solutions (Sivakumar & Mahadevan,

2024). The project implemented a customized customer relationship management (CRM) software

suite, based on a Time and Material billing model and a V-process method in the software

development lifecycle. It took some time for the project to reach the system testing by the end of

February 2017. However, ECL experienced some critical problems like the low productivity and

the under delivery of the needed software solutions of high quality resulting in the client

dissatisfaction.

Question 1: Nature of Customer Complaints and How to Address the Problem

ECL has received a lot of customer complaints from H&K and these complaints are mainly

concerned with the slow team performance, unnecessary staffing, communication problems,

domain knowledge deficiencies, and the mistakes in the deliverables. These complaints range in

projects' phases indicating that the problems are not an isolated incident but a systemic one. The

constant presence of these dissatisfactions pinpoints severe issues in productivity, quality and

project management.

Effects on Quality

The recurring complaints about slow work performance and overstaffing at a team are a

sign of inefficiency and a likely problem in resource management. Communication problems and
4

domain knowledge limitations indicate deficient information flow and insufficient comprehension

of client needs. Errors in the deliverables shows evidence of poor quality control and assurance

system. Therefore, these problems compromise the quality and reliability of the software being

produced, thus rendering clients dissatisfied and endangering the ECL’s reputation.

Figure 1: Root Cause Analysis

Root Cause Analysis and Solutions

A thorough root cause analysis reveals multiple factors contributing to these issues:

• Test Data Identification: Complex SQL code required for identifying relevant test data

slows down the process.

• Deployment Delays: Development team’s delays in deploying software updates impact the

testing schedule.

• Insufficient Hardware: Testing team's computers lack sufficient RAM, causing slowdowns.

• Network Latency: Latency issues when accessing the client’s test environment further

reduce productivity.
5

• Manual Testing: Manual testing processes are time-consuming and prone to errors.

Solutions

• Automate Test Data Identification: Implement automated tools for generating test data,

reducing dependency on manual SQL coding.

• Upgrade Hardware: Invest in high-performance computers with adequate RAM for the

testing team to enhance processing speed.

• Improve Network Infrastructure: Work with the client to optimize network settings and

reduce latency issues.

• Introduce Testing Automation: Adopt automated testing tools to streamline the process and

reduce errors, particularly for regression testing.

• Resource Optimization: Reassess staffing requirements and align resources more

effectively to balance workload and avoid overstaffing.

Question 2: Which Problems Should ECL address on a priority basis

Check Sheet

Complaint Category Frequency Percentage Cumulative

Percentage

Team Working Slowly 14 39% 39%

Too Many Errors 9 25% 64%

Excess Staffing 7 19% 83%

Communication Issue 4 11% 94%

Domain Knowledge 2 6% 100%


6

Pareto Chart

COMPLATINS-PARETO CHART
16 120%

14
100%
12

cumulative percentage
80%
Total Complaints

10

8 60%

6
40%
4
20%
2

0 0%
Team Working Too Many Errors Excess Staffing Communication Domain Knowledge
Slowly Issue
Axis Title

Frequency Cumulative Percentage

To find out what ECL should focus on urgently, an analysis was performed from the data

provided on the number of complaints from customers, and a Pareto chart was constructed. This

chart indicates the accumulated effect of each complaint type according to their frequency and

chances of being reported. In addition, some complaints have a larger operational effect than others

(Sivakumar & Mahadevan, 2024).

The first and most common problem is "Team Working Slowly" (TWS) that stands for

39% of complaints. This implies that there is a necessity for improvement in the processes that

will be used to simplify workflows and manage resources. Moreover, reviewing and resolving

take-off time postponements and infrastructure problems may be a proper approach to tackle this

challenge.
7

The second most dominant complaint is "Too Many Errors" (TME), which is a total of

25% of the total complaints. To deal with this issue, ECL should introduce automatic testing tools,

which will decrease manual errors and hold training sessions to improve the effectiveness and

accuracy of the testing process. Enforcing quality control standards is one of the ways to eliminate

errors during project completion.

However, ES is only 19% of total complaints but still needs to be taken into account. ECL

may need to reconsider its staffing plan and balance the team size with the project requirements.

It may be a good way to optimize the use of the resources and to prevent any inefficiencies due to

overstaffing.

Complaints for "Communication Issues" (CI), which add up to 11% and "Domain

Knowledge" (DK), which is 6% of the total complaints, are less pressing but still deserve attention.

Better communication channels between team and clients and giving domain specific training

sessions may solve CI and improve DK, respectively (Sivakumar & Mahadevan, 2024).

Eventually, through focusing on "Team Working Slowly" and "Too Many Errors" and

dealing with other issues as well, ECL can increase productivity, quality, and customer

satisfaction. By introducing these actions as a result of Pareto analysis, it will be possible for ECL

to eradicate the root causes of these complaints effectively, which, in turn, will result in better

project outcomes and overall performance.

Question 3: Is the system testing process under control?

Sample LCL UCL cbar

81 54.63 108.87 81.75

82 54.63 108.87 81.75


8

81 54.63 108.87 81.75

74 54.63 108.87 81.75

75 54.63 108.87 81.75

81 54.63 108.87 81.75

83 54.63 108.87 81.75

86 54.63 108.87 81.75

88 54.63 108.87 81.75

82 54.63 108.87 81.75

86 54.63 108.87 81.75

86 54.63 108.87 81.75

88 54.63 108.87 81.75

73 54.63 108.87 81.75

84 54.63 108.87 81.75

76 54.63 108.87 81.75

74 54.63 108.87 81.75

85 54.63 108.87 81.75

82 54.63 108.87 81.75

88 54.63 108.87 81.75


9

Control Chart
120

100

80

60

40

20

0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

Sample LCL UCL cbar

The information provided (sample values, lower control limit (LCL), upper control limit

(UCL), and a mean (cbar)) can be used to study the stability of the testing process (as seen by

Aslam). The process performance over time can be analyzed by constructing the control charts for

both sample mean and range.

In the control chart of the sample mean, the mean (cbar) is calculated at 81. 75. The LCL

and the UCL are usually estimated using statistical procedures and are taken as ± 3 standard

deviation of the sample. On the other hand, this dataset specifies LCL and UCL values—54. 63

and 108. 87, respectively. The values confirm that the sample mean falls within the range of

established control limits hence the process is stable (Sivakumar & Mahadevan, 2024).

In contrast, for the range control chart, the range is calculated as a difference between the

maximum and minimum values within each sample. The LCL and the UCL for the range chart are

generated through statistical calculations. In this case, the described LCL and UCL values also

show that the range is within the predefined control limits.


10

With all the sample mean values and range measurements within the control limits, it is

evident that the system testing process, which was depicted by Aslam, is under control. The

implication here is that the process is uniform and it behaves predictably in accordance with the

performance standards.

On the other hand, although control charts signal process stability, continuous observation

and analysis are imperative. Any notable fluctuations or trends need to be investigated in detail to

guarantee the process is improved and quality standards are maintained. Frequent monitoring

serves the purpose of ensuring the stability of the process and enables the administrators to fix the

problems that might emerge in a timely manner. As a result, the effectiveness and reliability of the

system testing process are enhanced.

Question 4: Is Network Latency a Significant Reason for underproductivity?

Network Latency Issues by Time


240

235

230

225

220

215

210

205
0:00 2:24 4:48 7:12 9:36 12:00 14:24 16:48 19:12

Figure 2: Network Latency Scatter Plot


11

Figure 3: Linear regression for Network Latency and effect on Productivity


12

According to the PSDA (Plan-Do-Study-Act) cycle, it is shown in the previous analysis

that there is a weak positive correlation between network latency and productivity, which can be

understood by the regression analysis. The coefficient of determination (R-squared) value of

approximately 0.172 suggests that around 17.2% of the variation in productivity metrics can be

attributed to changes in network latency. Nevertheless, there is no correlation that is statistically

significant as the p-values are not associated with the regression coefficients. (Sivakumar &

Mahadevan, 2024 ).

In the Plan phase, the organization is to consider the effects of the regression analysis and

decide on the possible actions which deal with the network latency problems. This might include

inspecting the existing network infrastructure, identifying the possible problems of latency and

designing the mechanisms to resolve the problems of network performance.

In the Do phase, the company can undertake measures aimed at minimizing network

latency, for example, by upgrading the network hardware, optimizing network configurations, or

applying traffic prioritization techniques. These activities shall be well-organized and conducted

in manner that avoids disturbing already ongoing activities.

In the Research stage, the organization should continuously measure the outcome the

interventions have on network delay and productivity metrics by means of various tools. This could

entail getting more information about network performance and productivity levels after

implementing the interventions.

Lastly, during the ‘Act’ phase, the firm evaluates the interventions employed to determine

whether they were effective in addressing network latency issues and increasing productivity. On
13

the basis of this assessment, the organization may decide the interventions to be refined, scaled up

or explore other approaches to address the remaining issues.

By following the PDSA cycle, the organization can systematically plan, execute, and revise

the interventions that will increase network performance and productivity. This iterative strategy

ensures the organization keeps learning and improving, and updates their strategies based on real-

time feedback and situations.

Question 5: Recommendations

According to the Karamath customer complaints analysis and the identified main causes, the

suggestion to Karamath about addressing customer complaints is to focus on interventions that

deal with the most critical issues that are affecting the customers’ satisfaction.

• Firstly, Karamath should concentrate mainly on the problem of the slow team work (39%).

This might include implementing the steps to enhance team efficiency, namely, offering

more trainings or streamlining communication channels or remapping the jobs to better

utilize team members' skills.

• Secondly, efforts should focus on reducing the frequency of software errors development

process which is a second most complaint (25%). This could be done by strengthening

quality control systems and having a rigorous review process and/or investing in automated

testing tools to find and fix errors easier.

• Additionally, Karamath needs to deal with the issue of over-staffing (19%) by management

of resources and by making certain that the project team is adequately sized to be able to

meet the project needs without unnecessary overhead.


14

• Furthermore, communication problems (11%) should be addressed by enhancing a culture

of open communication inside the project team and with the client, organizing regular

feedback sessions, and creating clear ways to handle complaints and resolve conflict.

• Lastly, discarding the residual problems associated with domain knowledge (6%) needs

targeted training and development programmes that help the team members improve the

expertise in related fields.

Conclusion

Eventually, the ability to cope with customer complaints is vital for keeping customer

satisfaction and guaranteeing the success of any software development projects. Through

analyzing the essence of complaints, pinpointing the root causes, and ranking the interventions,

Karamath and the ECL team can act in a proactive way and deal with the basic problems that

hinder the project's success. By concentrating on improving team efficiency, quality control

measures, resource allocation, communication channels, and domain knowledge, ECL can

showcase its dedication to providing the best services that clients expect. Through continuous

improvement efforts guided by the PDSA cycle, ECL is not only able to address current customer

problems but also help to build a culture of excellence and innovation that leads to long-term

success in the delivery of software solutions.


15

References

Sivakumar, S & Mahadevan B., (2024). Exceed: Improving Productivity and Reliability in

Delivery of Software Solutions. Indian Institute of management Bangalore.

You might also like