You have been hired by ACME Calculators to implement an automatic quality assurance process for their product. They have recently transitioned from hardware calculators to software calculators, and despite the numerous flaws in their business model, are persisting with the aim of providing the best calculator widget the world has ever seen. They have two products: an online calculator written in javascript and HTML (and hosted on this very page), and a python class for performing calculator operations. They expect these two classes to be conformant so that test cases can be written and designed for both simultaneously.
You have been ask to build a quality assurance process around these software assets, given the following requirements:
- The quality assurance process should include tests at both the unit level and the user level. It may also stipulate other qulity control processes such as periodic reviews, or assessments via code metrics.
- The quality assurance process should have well defined metrics that can be tracked as the project proceeds.
- Whereever possible, the tests should be automated.
- The should be a well defined set of procedures for assuring the quality of the software. This should stipulate the frequency of testing and review, the coverage of tests, and the reporting and tracking of quality and test metrics.
For this project you should produce:
1. A test suite including
o Unit tests, using unittest for the python code.
o User tests, using selenium for the web code.
o Clear instructions for setting up the test environment, and automatically executing the tests
2. A quality assurance manual including
o Test design process. Describe the software models, and coverage goals used to design your test suites.
o Test and software metrics. Describe the important software metrics and test metrics that contribute to your quality assurance process
o A clear description of any other quality assurance/testing techniques that should be used in conjunction with your automated tests
o A description on how and when the tests should be run, and a current test report, showing defects and recommended improvements.
o A list of assumptions made in designing the quality assurance process.
o A list of any references and resources used.