25 April 2007

Despite the name, most of QA groups/departments in the software industry are not QA departments at all. They are a testing group that design, implements and execute test plans, test cases and test scripts. Nothing wrong with that indeed!. However, the next step to improve the quality of the software is to go beyond the testing phase and create a culture of quality among all the participants of the software development process.


How is possible to begin this culture of quality? Ideally you will implement any of the existing models (CMMI, ISO...), however, given the amount of effort and time (so, money!) involved, it is usually difficult to get committed support from senior management. A group that incidentally looks at testing and QA as non-core/non-fundamental software development process activity.


Here at Visiphor the Test Group is reinventing itself into a QA group by pushing the following list of actions that are easy to implement. Incremental change is powerful if steady. You do not need to apply all the items, you can pick and choose or add your own. However consistency is important. If you pick one of the items, you need to keep it during all the development cycle: it doesn't make sense to peer review version 1, 2 and 4 of a document but not versions 3, 5 and 6 of the same document!


Here is the list. Comments, suggestions and real life stories gladly accepted. I would love to read your comments and what has worked (or not!) for you.

ActionDescriptionWho is responsible?Phase
Peer review of documents (architects)Each document is reviewed at least by another member of the Architects team Architects ArchitectsPlanning
Peer review of documents (developers) Each document is reviewed at least by another member of the developers teamDevelopmentPlanning, Development
Peer review of documents (tester)
Each document is reviewed at least by another member of the testing team
Testing Planning, development, stabilization
Peer review of documents (systems)Each document is reviewed at least by another member of the systems engineer team Sys. Eng. Planning, development, stabilization, deployment
Solution Setup (developers)
A senior developer creates the Visual Studio solution(s), project structure, and namespace framework.
DevelopmentPlanning or Development
Source Control Repository Setup A senior developer adds the solution(s) to the source control repository. Development Development
Code Reviews (developers) Similar to the peer reviews of documents, the code for the application is regularly reviewed by another member of the team or by an automatic tool. Development Development
Kick off meeting. Also known as Launch Meeting.Everybody involved in the project needs to be present. The purpose of this meeting is to fulfill several of the MSF principles of common goals, vision, foster communication…. PM Planning
Setup and use of Issue tracking system
An Issue Tracking System needs to be set up for every project, in addition, it needs to be the central collaboration tool that each team member uses to identify, record, triage and solve bugs and change requests. Testing Planning
Sign on at each iteration/Marking Iteration boundaries The beginning of each new iteration (as defined in the MSF process) should be marked by a team meeting with the same purpose as the Launch meeting. Iteration ends should at least be marked by an email from the PM, and in some cases by a post-mortem-like team meeting. The goal is to keep everybody informed, and with the same objectives. PM Through the lifecycle of the process
Dedicated Test environment The Test environment should be used exclusively by testers and not shared with development. PM/Sys Eng/Testing Development, stabilization
Unit test Developers, should unit test each piece of their code either manually or using automated tools Development Development, stabilization
Define the Scope for every project. It is important to define what is in the project and what is out. Gray areas will always exist but need to be minimized.PM, Development, TestingEnvisioning
Customer involvement in the testing effort of User Interfaces The rationale of this point is based in the premise the customer is the best to judge the user interface: both the information contained, the user-friendliness, the work flow and the business logic behind it . In this context, if the customer is involved in the testing, the quality of the end product will be better. PM Stabilization, deployment
Project will proceed in a continuous stretch with not time gaps in between. When a project stops, and then restarts, a lot of the knowledge accumulated is lost. Projects done as a continuum will have better chances to reflect better the customer original intentions.
PM Through the lifecycle of the process
Post-mortem meetings a the end of each iteration In a multi-phase or multi-iteration project, this practice should help to improve process and correct problems that have appear in previous phases PMEnd of the project
Setup and use of Change Request Procedure The team, PM and customer should set up a procedure to deal with new/changed requirements. I should include a risk assessment for the requests. Testing, everybody Planning
Setup and use of Requirements System A centralized requirements repository will reduce the dispersion of information and ensure all the member of the team share a common list of requirements.
It may allow the possibility to generate metrics and be able to show to the customer all the requirements changes.
BA, Testing, PM Planning
Data dictionaryA spreadsheet or document that describes the name, meaning, type and other information about the fields of a database and how they transform
(if applicable, as not all the projects may recommend a data dictionary)
BA, Development, testing Planning, Development
Monitoring of the systems for unauthorized changes This monitoring should be associated with clearly defined consequences for intentional unauthorized changes Everybody All phases

Soon I will post a second list of recommendations that are a little bit harder to implement or less applicable to all projects.

Note: The "Phase" is in the context of the Microsoft Solutions Framework (MSF), and are orientative. Some of the tasks do not have a clearly defined phase in which they need to be done.