10 July 2007

Adding/modifying work items in Team Foundation Server -Part 1

As most of you in the trade will know, Microsoft released in 2006 Team Foundation Server (TFS), a new product/tool that allows testers, developers and architects to work together using Visual Studio as its GUI. In this way, a seamless environment will be created where all these roles can work together, or at least this is what the Sales&Marketing department would like us to believe. In the practice, this level of integration is some iterations away.

TFS out of the box include two approaches: CMMI and Agile. In both of them it has the concept of work items (WI), among them, it has a WI named 'Bugs'. Unfortunately, I find the Bug WI included in these templates not very useful. So, if you want to create a new Bug WI in TFS with the product as it is out of the box, you will get the following

Enlarging the tab section (apologies for the bad quality of some of the images...)


As a tester I am surprised to see how 'developer' oriented is this interface. For example: I couldn't care less about the fix, however, however, I think it is very important to describe the steps to reproduce the bug. This is a single example... there are several more fields/tabs I would like to see that are not there by default!.

So, how you manage to customize TFS to your needs? This blog will guide you to the process of creating/editing work items.

First you need to have Visual Studio 2005 on your machine. Then, you will need to download the following tools from Microsoft:

http://go.microsoft.com/?linkid=6270225
http://msdn2.microsoft.com/en-us/vstudio/aa718351.aspx

The tool properly is the second link, but you need the components included in the first.

Once is installed, you will be able to access the documentation, that is pretty clear. You access the documentation from Start>All Programs>Microsoft Team Foundation Server Power Tools>Microsoft Visual Studio Team System Process Editor>PEUserGuide.doc

If you want to modify a WI, from Visual Studio you select the menu item Team>Process Editor>Work Item Types>Open WIT from Server

You will get the following interface

In this case, 'Add' a new control (controls in the .NET sense, like text boxes, drop down...) with type Plain Text. The reference name used in this case is Visiphor.Steps, the first part is the namespace used internally and the second part anything you want. For this example, I have created a new control named 'Steps to reproduce.

The second part of this article will refer of how to add this control to a WI.

04 June 2007

Second part of the list, as promised! I feel a bit less strongly about the recommendations in this second list. In some cases, I would advise a 'menu approach' that will allow the team to pick and choose.


As before any omments, suggestions and real life stories will be most certainly welcomed!





ActionDescriptionWho is responsible?Phase
Code CoverageThe new Visual Studio suite offers the possibility to explore all the possible paths of a piece of code. If all the lines of code are executed at least once in a test environment, it is less probable that they will contain critical errors. Also, if there are areas of the code that are never accessed, it would point to areas where maintenance can be compromised.DevelopersDevelopment
Tracing requirements to Use Cases/Test Cases This would add overhead to the QA operation, however, it may help to keep all the requirements in sight and also limit their scopeTester/PM

Planning, Development, Stabilization

Sign on at each milestone. My proposal would be that at each milestone the PM MUST send an email to the team announcing it. This means that a change in design (Planning) after the ending of the Planning phase will not affect developing. The change will affect next iteration (Thinking in MSF context).
This may seem draconian, but may help architects, PM and Customer to be more conscious when they are breaking the process.

PMEnd of each phase inside the iteration
No switching of resourcesEvery time that resources are brought in/out of the project, there is a learning curve and information that is lost. A project with a big resource turn-over risks to have a larger amount of undetected issuesPMAll phases
Representative Test environmentSometimes, due to the complexity and expense of the production system, the test environment is significantly different from the Production Environment. If the environment are similar, the test effort twill be much more accurate
PM, System Engineering, TestingStabilization
Risk ManagementCore to the MSF, it should include the customer/customer representative. The extra overhead is well compensated by the managed approach to problem when, if they, appear. PM, EverybodyAll phases
Real and represenative test DataIf the customer supplies real and representative test data, it is easier and more probable to spot problems/code deficiencies during the test process PM, TestingDevelopment, stabilization
Customer agreement on qualityCustomer should take an active role defining what they expect of the product. PM

Envisioning

Formal Security Review (if applicable)For project that require a high level of security, in addition to the usual test procedures –encryption, use of certificates, users rights…- it also should be submitted to deliberate attacks to try to break into the applicationSys Eng/TestingPlanning, stabilization, deployment
Cross disciplinary Peer review of documentsThis could identify issues that are more obvious to another team.EverybodyAll phases

25 April 2007

Despite the name, most of QA groups/departments in the software industry are not QA departments at all. They are a testing group that design, implements and execute test plans, test cases and test scripts. Nothing wrong with that indeed!. However, the next step to improve the quality of the software is to go beyond the testing phase and create a culture of quality among all the participants of the software development process.


How is possible to begin this culture of quality? Ideally you will implement any of the existing models (CMMI, ISO...), however, given the amount of effort and time (so, money!) involved, it is usually difficult to get committed support from senior management. A group that incidentally looks at testing and QA as non-core/non-fundamental software development process activity.


Here at Visiphor the Test Group is reinventing itself into a QA group by pushing the following list of actions that are easy to implement. Incremental change is powerful if steady. You do not need to apply all the items, you can pick and choose or add your own. However consistency is important. If you pick one of the items, you need to keep it during all the development cycle: it doesn't make sense to peer review version 1, 2 and 4 of a document but not versions 3, 5 and 6 of the same document!


Here is the list. Comments, suggestions and real life stories gladly accepted. I would love to read your comments and what has worked (or not!) for you.

ActionDescriptionWho is responsible?Phase
Peer review of documents (architects)Each document is reviewed at least by another member of the Architects team Architects ArchitectsPlanning
Peer review of documents (developers) Each document is reviewed at least by another member of the developers teamDevelopmentPlanning, Development
Peer review of documents (tester)
Each document is reviewed at least by another member of the testing team
Testing Planning, development, stabilization
Peer review of documents (systems)Each document is reviewed at least by another member of the systems engineer team Sys. Eng. Planning, development, stabilization, deployment
Solution Setup (developers)
A senior developer creates the Visual Studio solution(s), project structure, and namespace framework.
DevelopmentPlanning or Development
Source Control Repository Setup A senior developer adds the solution(s) to the source control repository. Development Development
Code Reviews (developers) Similar to the peer reviews of documents, the code for the application is regularly reviewed by another member of the team or by an automatic tool. Development Development
Kick off meeting. Also known as Launch Meeting.Everybody involved in the project needs to be present. The purpose of this meeting is to fulfill several of the MSF principles of common goals, vision, foster communication…. PM Planning
Setup and use of Issue tracking system
An Issue Tracking System needs to be set up for every project, in addition, it needs to be the central collaboration tool that each team member uses to identify, record, triage and solve bugs and change requests. Testing Planning
Sign on at each iteration/Marking Iteration boundaries The beginning of each new iteration (as defined in the MSF process) should be marked by a team meeting with the same purpose as the Launch meeting. Iteration ends should at least be marked by an email from the PM, and in some cases by a post-mortem-like team meeting. The goal is to keep everybody informed, and with the same objectives. PM Through the lifecycle of the process
Dedicated Test environment The Test environment should be used exclusively by testers and not shared with development. PM/Sys Eng/Testing Development, stabilization
Unit test Developers, should unit test each piece of their code either manually or using automated tools Development Development, stabilization
Define the Scope for every project. It is important to define what is in the project and what is out. Gray areas will always exist but need to be minimized.PM, Development, TestingEnvisioning
Customer involvement in the testing effort of User Interfaces The rationale of this point is based in the premise the customer is the best to judge the user interface: both the information contained, the user-friendliness, the work flow and the business logic behind it . In this context, if the customer is involved in the testing, the quality of the end product will be better. PM Stabilization, deployment
Project will proceed in a continuous stretch with not time gaps in between. When a project stops, and then restarts, a lot of the knowledge accumulated is lost. Projects done as a continuum will have better chances to reflect better the customer original intentions.
PM Through the lifecycle of the process
Post-mortem meetings a the end of each iteration In a multi-phase or multi-iteration project, this practice should help to improve process and correct problems that have appear in previous phases PMEnd of the project
Setup and use of Change Request Procedure The team, PM and customer should set up a procedure to deal with new/changed requirements. I should include a risk assessment for the requests. Testing, everybody Planning
Setup and use of Requirements System A centralized requirements repository will reduce the dispersion of information and ensure all the member of the team share a common list of requirements.
It may allow the possibility to generate metrics and be able to show to the customer all the requirements changes.
BA, Testing, PM Planning
Data dictionaryA spreadsheet or document that describes the name, meaning, type and other information about the fields of a database and how they transform
(if applicable, as not all the projects may recommend a data dictionary)
BA, Development, testing Planning, Development
Monitoring of the systems for unauthorized changes This monitoring should be associated with clearly defined consequences for intentional unauthorized changes Everybody All phases

Soon I will post a second list of recommendations that are a little bit harder to implement or less applicable to all projects.

Note: The "Phase" is in the context of the Microsoft Solutions Framework (MSF), and are orientative. Some of the tasks do not have a clearly defined phase in which they need to be done.