|M.Sc Thesis||Department of Quality Assurance and Reliability|
|Supervisor:||Dr. Daniel Galin|
Many software development professionals and managers are not fully convinced of the cost-effectiveness of investments in programs for improvement of the quality assurance systems (programs for CMM level transition of the organization). Results of available articles are not conclusive.
The first part of the work presents a comprehensive quantitative analysis of past studies (secondary analysis) that was based on CMM level transition (CMMLT) analysis of available publications for the seven most common performance metrics. The CMMLT analysis is especially suitable for combined analysis of empirical data from a diversity of sources as each one of our database records is a normalized “after-before ratio”, which signifies improvement achieved in a given metric. and is independent from the studied organization’s characteristics.
The extensive database covering over 400 projects from 19 information sources support the secondary analysis results - the proved contribution of investments in CMM level transition programs to improved software development performance according to all seven metrics.
The second part of the work presents a comparative field study of the performance of two organizations, a start-up company evaluated as CMM level 1 (“The Cat”) and an established ISO-9000 certified company, evaluated as CMM level 3 (The Tiger”). The comparison was based on one year records of both companies that performed similar projects, the similarity pertaining to team size, software development tools and complexity of project.
To comparison referred to the following performance metrics: error density, productivity of software development, percentage of rework, cycle time for the completion of bug fixing, percentage of reopen, error detection effectiveness.
The Tiger’s performance results were found better than those of The Cat, however part of the results were not statistically significant
Based on the secondary analysis and the field study we may conclude that a significant performance improvements according to the seven metrics, is expected as a result of investment made in the SQA system.