Skip to main content

Running Your Test Cases

How test cases are run in TestCollab?

Running your test cases is important as it tells you if the application you are testing is working as expected.

In TestCollab, you can run your test cases using Run now button on test plan summary or test plan test cases page.

Test Run page contains following sections:

Running a test case in TestCollab

Test Cases List

All test cases included in test plan or under current configuration that are listed on the grid can very well be managed in a similar way it is done on test cases page. That means you can sort test case, filter them, show or hide the columns on grid and select one or more test cases at once and perform operations in bulk.

Bulk actions can be performed by selecting:

  • Multiple test cases using checkbox manually, or

  • Clicking checkbox in Table header to select all test cases

Actions that can be performed in bulk on selected test cases:

  • Changing status (marking it as Passed/Failed/Skipped/Blocked)

  • Changing assignee

  • Removing from test plan

Changing the order in which test cases will be executed by a tester

By default the test cases are shown in the same order as on test cases page, when we are running them under a test plan.

A tester can change the order in which test cases are to be executed as per their convenience.

Change the order of test cases to be executed under a test plan in TestCollab

Test Case View Pane

Clicking on any test case from Test case list opens up the view pane, it shows all the information about the test case.

In view panel, you can see all steps and expected results. You can also see comment as well as result posted by tester for each step is test case view pane.

Adding new test cases from run page

There is a "+" button on the run test case page that allows users to add a new test case to the test plan without needing to switch to the test case management page.

Adding a test case from run test case page in TestCollab

Run Bar

What you would see on the run panel partially depends on whether the test case to be executed has steps or not.

Enabling / disabling step-wise run

When the test case has steps you can opt to log the execution results step wise or you may log it for entire test case at once.

The run bar in TestCollab

Commenting

Tester can leave comments to communicate observations during the execution, if step wise run is enabled then a comment can be added for every step being run, otherwise the comment would get associated with the entire test case.

Editing comments

Comments added during earlier RUNs of a test case can be edited when required. An administrator can modify comments added by any user in previous RUNs. Limited rights users can edit only their own comments, provided the β€œAllow Editing Step Comments” setting is enabled for the project by an administrator.

Attaching files

There is often a need to attach files and artefacts to support the status you are setting for test case. All file types that are safe and valid are supported. If step wise run is enabled then the attached file will get associated with the current step otherwise it would be for entire test case.

Setting the result

Tester can mark each step as passed, failed, skipped or blocked.

Tester can:

  • Set status for an individual step

  • Set same status for currently selected step and all the remaining steps in the test case.

  • If step-wise run is disabled then the status would apply to the entire test case

Setting status for all / remaining steps in test cases at once.

If step-wise run is enabled , there is an option to set same status for currently selected step and for all remaining steps in the test case using the dropdown available next to the respective status buttons.

Setting test cases for current and remaining steps for a test case in TestCollab

Reporting a bug for test case failure

If defects management is enabled for the current project then tester would get an option to not only mark a step or entire test case as failed but also report a bug in linked defects manager.

Understanding the timer

As soon as a test case (that is assigned to current user) is selected for execution, a timer would start to show the time spent while testing current test case, and it will continue to show and increment the time elapsed every second until :

  • The status for all the steps in test case are not set (if step-wise run is enabled) and you are automatically taken to next test case

  • You have set status for entire test case and you are automatically taken to next test case (If there are no steps or step-wise run is disabled)

  • You manually navigate away from the test case by switching to next or previous test case

  • You change the selected configuration

  • You switch to some other page in the app

Note: A tester can also pause the timer if required.

Navigating between the test cases

Navigating between steps and test cases while running them in TestCollab

Arrows on run panel can be used to navigate to immediately next or previous test case in the sequence. You can also click on a test case on grid to directly switch to that test case.

Progress Bar

The step progress ring in TestCollab

Based on total number of test cases under the test plan or current configuration and the number of test cases executed so far, you would see the the progress of execution.

Step Progress Ring

When a test case has steps and step-wise execution is enabled, you may sometimes execute only some of the steps before moving on. For such partially executed test cases, a step progress ring appears around the status icon in the test cases grid.

Step progress ring in TestCollab

The ring gives you a quick visual indicator of how far the execution has progressed for each test case:

  • The filled portion of the ring represents the percentage of steps that have been executed

  • The color of the ring reflects the status of the last executed step (e.g., green for Passed, red for Failed, yellow for Skipped, blue for Blocked)

  • The ring only appears for test cases that are still marked as Unexecuted overall but have some steps already executed Hover over the ring to see a tooltip with details:

  • How many steps have been executed out of the total (e.g., "3/7 steps executed")

  • The status of the last executed step (e.g., "Last step: Passed")

This makes it easy to identify test cases that need attention during a run. You can quickly spot which ones were started but not yet finished, and what the latest result was.

Quick Filters

Quick filters for test cases on test cases run page in TestCollab

Other than the filters available for test cases on grid, there are also 2 quick filters: "Show only assigned to me" and "Hide already executed"

Configuration Selector

Switch to other test plan configuration in TestCollab

If configurations have been defined at the time of test plan creation then you can select the configuration for which you want to run the test cases now.

Did this answer your question?