Category: Test Management

Introduction In our test management tool side-by-side feature comparison we identified well over 100 features that you can use to compare the different tools. Not all of the features are significant though. In this review we pick a few of those features and take a look looking at how Zephyr Scale addresses 7 complexities of test management. Those complexities and core features are: Assignment Version Control Parameterisation Libraries Results Aggregation Retesting Configurations and Releases Assignment Test cases are executed in cycles within Zephyr Scale. The cycle has an owner at the top level. Then you can assign individual test cases can to specific testers for execution. This is also supported with an 'Executed by' field that shows who actually ran...

Introduction The functional analysis of test management tools can be broken down into more than 100 separate features. In fact, our our side-by-side test management tool feature comparison has identified well over 100 features. Having lots of features isn’t always a good thing. Let’s face it not all of them are significant. However, there are 7 core and complex features that every test management solution has to address in one way or another. The core features are: Assignment Version Control Parameterization Libraries Results Aggregation Retesting Configurations and Releases In this write-up, we’ll be seeing how Xray stands up to the 7 criteria listed above. Assignment Xray implements test cases as Jira issue types. When you start out with Xray, you...

Introduction QMetry is a test management tool that enables users to increase efficiency in managing their testing. Yes it delivers the basics of creating test cases but QMetry also has some clever ways to help with test case reuse.There are lots of aspects to a test management solution and our side-by-side test management tool feature comparison has identified more than 100 of them. However, there are 7 core and complex features that every test management solution must address in some way. The 7 core and complex features are: Assignment Version Control Libraries Results Aggregation Retesting Configurations and Releases In the following sections we look at how QMetry addresses each of these 7 features. Assignment The two ways to assign tests in...

One of the stand out moments in 2015 has to be the high profile fall out in one of the biggest sports in the world. A fall out between one of the most successful partnerships of all time in Formula 1. A fall out that had many parallels with the way testers are treated in our industry. The Chairman of Renault, Carlso Ghosn, stated publicly that he wanted to sever ties with Red Bull. One of the most successful F1 partnerships of all time, Red Bull and Renault, fell out. Why? Carlso explained that… “Unfortunately when we were winning championships the Renault name was never mentioned. It was the [Red Bull] team that was winning”. And when things weren’t going so...

It’s the start of a new project. Everyone is throwing in design ideas. Lot of excitement. Bit of a buzz. High level architecture is taking shape. Wire diagrams for the GUI are nearly finished. ‘This’ system will talk to ‘that’ system. You know which systems are storing the different pieces of data. Front end will be mobile iOS and Android. We’ll use a REST api to talk to the back end. The design is looking good. And everybody’s off. All beavering away. All building their own little bit of the system. Won’t be long before we put all the different parts of the system together for the first time. See it all working as a system. Sure… we’ll find a...

Chesley Sullenberger, the pilot who landed an Airbus A320 on the Hudson explained in an interview that “Everything we know in aviation, every rule in the rule book, every procedure we have, we know because someone somewhere died…. We have purchased at great cost, lessons literally bought with blood that we have to preserve as institutional knowledge and pass on to succeeding generations. We cannot have the moral failure of forgetting these lessons and then having to relearn them.” How would our practice of software testing improve and our discipline be enhanced if mistakes we made resulted in people dying? For some of us they can and do result in people dying. In many industries like medical devices and air...

You’ve configured your test hosts (Bringing Manual and Automated Tests Together) and you’ve set up and run automated tests from QAComplete (Setting Up Automated Tests in QAComplete). Now we’re running these automated tests how do we track the results and how do we follow the traceability back to our requirements? Traceability For many of our automated tests we’ll want to track traceability back to the requirements they are providing us with test coverage on. From an QAComplete implementation point of view automated test cases are no different to manual test cases. Automated test cases are defined in QAComplete and linked back to the requirement. This traceability can be seen and modified when you view the test case in the test...

We’re going to continue with our look at how to combine manual and automated tests with QAComplete and TestComplete. We’ve already seen how to install and configure the Test Agent which connects QAComplete and TestComplete. Now we look at how to setup automated tests and execute them. You will need to configure the Test Manager Agent on the TestComplete clients machines before you follow these steps. More on this in Bringing Manual and Automated Tests Together Checking That Automation Hosts Are Available At this point we should have the agent installed and running on the TestComplete client machine. This process should show in Task Manager on the TestComplete machine as TestManagerAgent     -      Test Manager Agent You can also check in QAComplete...

Bringing manual and automated tests together to deliver combined reporting and traceability is an important goal for many QA teams. Usually this means linking an automated testing process into a manual test tracking tool. With the new 9.9 release of QAComplete and release 10.0 of TestComplete implementing an integrated solution becomes possible without investing vast amounts of money or lots of time and effort. In this post we’ll be looking at how to setup QAComplete and TestComplete integration. Then we’ll see how this can really benefit your QA efforts as we look at combined reporting and traceability in the follow up post. The high level architecture here revolves around having a central test management capability (delivered by QAComplete) and a...

For many, integrating your test management system with your automation environment is a key aim. Whilst Quality Center integrates with UFT and QTP out of the box, many have other integration requirements. In cases where you might be looking to integrate TestComplete automated tests with Quality Center the following set up and execution instructions may help. A few things need to be addressed as part of the initial setup. A couple of things on the TestComplete client side and a couple of things on the Quality Center server. For TestComplete and the TestComplete client machine you need to … 1) install the HP QC Connectivity Add-In on the TestComplete client machine. This utility is provided by HP and can be...