3 RESEARCH DESIGN AND
METHODLOGY
The prime intension of this perusal is to improve the
practice areas of the software testing service so that
small software firms will be able to reach maturity
level 3 and above.
As we are concerned about software testing
services, we are trying to follow key questions Q1 and
Q2 which are mentioned in the introduction part. We
are analysing scenarios of current procedures
followed by small software organizations by using
these research questions.
In previous research, many researchers were
conducting their research based on improvement of
services, performance, and customer satisfaction and
suggested following certain terms to improve in
processes (Kundu, Manohar & Bairi, 2011). They
also analysed the process area using related process
areas components and facilitating them by sharing the
common understanding by using new technology
(Hashmi,Lane,Karastoyanova, & Richardson, 2010).
Overall, all the related work was based on the
improvement of better performance in terms of
CMMI-SVC. But we are discussing the existing
processes that small software firms follow and
providing them suggestions to improve services,
performance and customer satisfaction. According to
our objectives of this paper which is based on the
major testing process challenges of current practice
and evaluate the maturity of small software firms in
Bangladesh, we reviewed other research papers so
that we can get a clear concept regarding this topic.
Then we tried to find out the gaps through conducting
surveys with 11tech SMEs. We have prepared a
survey questionnaire and sent it to the lead tester of
these SMEs and those 11tech SMEs are classified
based upon the following metrics: Age, Size, Project
Based/Service Based, Number of Employees and
Location (City). After analysing the data, we can
understand the process or methods that company’s
currently following and the gaps of their activities.
Finally, we proposed a framework which would
eradicate their lacking and consider the budget
limitation, resources, testing timeline and eventually
maximize the maturity level to 2 & above.
11tech SMEs have been chosen for our research
and classified based upon the following metrics: Age,
Size, Project Based/Service Based, Number of
Employees and Location (City). We have prepared a
survey questionnaire and sent it to the lead tester of
these SMEs also.
To evaluate the existing testing practices, we
collect data, though both online and offline survey.
To evaluate the data, we followed two methods,
Analysing Factors & Reliability analysis.
Factor analysis used to assess the observable
variables such as performance on specific practice
areas. It’s also useful for summarizing a large amount
of observations into a smaller number of factors. At
the early stage of the survey, we set the following 3-
scale for each question: 1-No (Not followed), 2-
Partial (Partially followed), 3-Yes (Followed). Then
we calculate the average value of each practice area
to assess the maturity of those organizations and be
able to understand the gaps of their following process
areas (PAs).
After collecting data, we followed Reliability
analysis. Basically, reliability analysis refers to the
consistency of measurement. This method can be
used to evaluate the survey questionnaire. The mean,
median, and mode are 3 ways of calculating the
average. We can use the scale for each question to
assess responses from surveys and each respondent
represents their activities, whether they conduct
testing services or not.
4 FINDINGS
4.1 Trend Followed by Companies
11 tech SMEs have been chosen for our research and
classified based upon the following metrics: Age,
Size, Project Based/Service Based, Number of
employees and Location. We have got 24 responses
from 11 companies different roles for 23 questions set
considering different practice areas of CMMI-SVC.
We considered 11 practice areas for our research,
such as PLAN, PQA, IRP, MPM, WMC, RDM, PR,
VV, II, ROM and EST.
We tried to know the trends of small software
companies, therefore we conducted a survey. For that,
we calculate the average value of each question which
is based on practice areas of CMMI-SVC. Table 1
shows the percentage of process areas, which refers
to small software company trends.
In table 1, we analyse the average value of each
process area that a small company usually follows for
testing services. We can summarize that almost
52.62% of companies follow the quality assurance
approach and 34.65% of the company partially
maintains the quality and process performance
objectives for work. We can understand the trends
and reason behind fluctuation maturity levels. The
percentage of LI goes downward when the maturity
level goes up; The PI has an upward trend with the
level. NI has the significant value for Level 0 & 2.