Release Notes 8.6.x
Build 8.6.4.2 - Release Date: 2020-11-11
Bug Fixes
Fixed a bug that prevented integrating with bitbucket repository with correct credentials.
Fixed a bug that caused users to get logged out abruptly while working in QMetry.
Fixed a bug that prevented the test cases in folders from loading for users who had a custom field enabled on the grid view which was deleted later.
Fixed a bug that could cause an error resulting in upgrade failure due to duplicate attachments.
Build 8.6.4.1 - Release Date: 2020-10-26
Improvements and Bug Fixes
Improvements
"Jira integration - QMetry Enterprise" app is now compatible with Atlassian's site rename feature.
Bug Fixes
Fixed a bug that did not display assignee information when Test Execution Summary Report by Assignee is exported.
Fixed a bug that scrolled up the grid header while linking assets through bulk operation.
Fixed a bug that prevented users from logging in to QMetry if password contains plus(+) character.
Fixed a bug that displayed an error while applying filter to the 'Test Execution Summary by Folder' report.
Fixed a bug that prevented navigating through test cases using previous and next buttons.
Fixed a bug that prevented loading of the default dashboard for SAML authenticated users after login.
Fixed a bug that forcefully logged out users after 15 mins of session idle time when multiple tabs are open.
Build 8.6.4 - Release Date: 2020-10-12
Improvements and Bug Fixes
Improvements
Improvements to Test Case and Test Execution
Summary and Entity Key are now separate columns on all link test asset screens to allow better sorting and filtering.
Enhanced test case steps edit experience with an option to open step details in maximized mode.
Users can view shareable test case steps in the test case without scrolling.
Test executions with archived release/cycle will be hidden by default.
Filter requirements by External key while linking them to Test cases and Test Suites.
Users can hide test steps “Input data” and “Expected Outcome” fields on the execution screen to utilize the space effectively.
Link Test case to Test suite panel now displays more test cases on the page.
Improvements to Jira Integration
QMetry authentication from `Jira Integration - QMetry Enterprise` app now supports Open API key (part of Open API app) and two step verification.
Jira field mapping configuration is now separate for each integrated issue type.
Test case panel, test case details view and test execution sections in Jira issues now have resizable columns.
Test case details view in Jira now displays all user defined fields.
`Jira Integration - QMetry Enterprise` app v2.0.9 is released compatible with QTM 8.6.4. Customers using Jira Server/DC need to update the app manually, while it is automatically upgraded for Jira Cloud. Server customers need to sync the meta data for all the projects integrated with Jira.
Improvements to Reports
Advance Query Reports database schema tables `Requirements` and `Issues` having field names starting with “Jira” are updated with “Ext”. (part of Advance Report app)
For more details refer this page.
Users will now be able to set any system or custom dashboard as their default dashboard seen after logging in to QMetry.
Introduced new report `Count of API Requests by User` which shows number of Open API or Automation API calls made by each user at a given time.
Share dashboards with specific users or all users of a specific role, project combination. (part of Advance Report app)
Improvements to Automation API, Bamboo/Jenkins/Maven Plugins
Upload automation results of Robot framework.
Added support for uploading automation results from a Bamboo remote agent server.
skipWarning parameter have been added that allows to import test cases by truncating summary having more than 255 characters.
QMetry Test Management for Bamboo (v1.0.9), QMetry Test Management Plugin for Jenkins (v1.10) & QMetry Test Management Plugin for Maven has been released with above supported improvements.
Improvements to QMetry Administration
QMetry Admin can now enforce two step verification for all users by making it mandatory. (part of Customization app)
Password expiry related email notifications will be sent to QMetry authenticated users in advance. Organization who have subscribed for customization app can even configure the advance number of days. (part of Customization app)
Users having two step verification enabled can now use recovery codes to regain access to the accounts.
Easily filter and find users having two step verification enabled on users list page.
QMetry Admin using On premise installation can now set a maintenance message that will be displayed on login screen to notify users about a scheduled maintenance. (part of Customization app).
General Improvements
Export exploratory testing session details, documented test steps and associated defects to a word document. (part of Exploratory Testing app)
Share defect details over email to users even outside of QMetry.
Import test cases with longer summaries now truncated to 255 characters using option to `Import with Warning`.
Gitlab support for BDD integration.
Bug Fixes
Fixed a bug that prevented cloning of a project when the project has test case or requirement with attachments moved from another project.
Fixed a bug that prevented auto linking of requirements to test cases when requirement key is specified in the automation result file.
Fixed a bug that prevented display of all records for a tabular view gadget when dashboard is shared using embedded URL.
Fixed a bug that displayed the test case execution for a deleted parameter value combination for custom reports generated using the Advanced Query module.
Fixed a bug that displayed html tags for large text user defined field when test case is exported to a PDF.
Fixed a bug that prevented proper loading of test case when accessed using URL with test case id.
Summary of Open Rest API Changes
The following APIs have been modified.
API Name | REST URL | Method | Backward compatibility with 8.6.3 | Request Change | Response Change |
List of Cycles | /rest/admin/cycle/list | POST | Yes | Yes | No |
Add BDD Configuration | /rest/admin/bddConfiguration/add | POST | Yes | Yes | No |
Fetch Executions for Issues | /rest/execution/getExecutionsForIssue | POST | Yes | No | Yes |
Build 8.6.3.4 - Release Date : 2020-09-18
Bug Fix
Fixed a bug that prevented the test case export to PDF.
Build 8.6.3.3 - Release Date : 2020-09-05
Improvement
Enhanced performance for group of APIs that are internally used for automation test result executions import.
Bug fixes
Fixed a bug that displayed incorrect entries for test case executions in custom reports when platforms are un-linked from test suites.
Fixed a bug that prevented syncing of Jira issue if priority field is not set for any of the imported Jira issues.
Build 8.6.3.2 - Release Date: 2020-08-31
Bug Fix
Fixed a bug that caused advanced query reports to give no output when opened in edit mode.
Build 8.6.3.1 - Release Date: 2020-08-27
Bug Fixes
Fixed a bug that prevented export of custom field values when test cases are exported in excel/csv.
Fixed a bug that caused project clone to fail when test case folder from one project is shared to another project.
Fixed a bug that showed a mandatory status field while creating issues from QMetry to Jira.
Build 8.6.3 - Release Date: 2020-08-17
Improvements and Bug Fixes
Improvements
Users with QMetry authentication type can enable Two-step Verification as an extra layer of security during login.
Improved performance for Automation API while importing result files of all frameworks.
Increased file size limit up to 30 MB for importing result using Automation API.
Bug Fixes
Fixed a bug that caused the saved mapping for excel sheet import of test cases to reset.
Fixed a bug that exported a blank PDF in some cases while exporting a test case.
Fixed a bug that prevented removal of execution records for deleted platforms from QMetry Insights.
Fixed a bug that prevented loading of test case steps on execution screen when actual outcome or comments had certain html tags.
Fixed a bug that prevented loading of ‘User Last Login Detail’ report when generated for high number of records.
Fixed a bug that prevented the download of QMetry IDP metadata files for SAML Configuration, if HTTPS is not configured with globally trusted SSL certificates.
Fixed a bug that prevented auto-syncing of Jira issues when issue type Bug is renamed in Jira.
Fixed a bug that prevented use of bullets & numbering in test case steps.
Fixed a bug that prevented import of automation result file (using Automation API) having multiple occurrences of a testcase.
Build 8.6.2.2 - Release Date: 2020-08-03
Bug Fixes
Fixed a bug that prevented loading of QMetry on IE browser.
Fixed a bug that caused pie chart gadgets to disappear on mouse hover.
Fixed a bug that automatically linked release and cycle to the test cases when a test suite is associated to a release and cycle.
Fixed a bug that caused custom report sync to stop working after an operation with large amount of data was performed in QMetry.
Fixed a bug that prevented loading of 'User Last Login Details' report on Login Summary Dashboard when generated with a large number of records.
Build 8.6.2.1 - Release Date: 2020-07-12
New Features/Improvements
Improvements on Test Execution against Builds
Now testers can assign a build for an individual test case execution. This helps when test cases in a same test suite are executed against multiple builds.
QA Managers can make build selection mandatory to ensure testers assign test executions against a build.
QA Mangers can set a default build for a release & cycle combination so that test executions are auto assigned an intended build, so that testers do not have set them manually.
Now view test case executed build information in the Test case - Test Execution details section along with other execution details.
Improvements to System and Custom Reports
New system dashboard “Test Execution Summary by Folder” is added under QMetry System reports. This dashboard has two reports :-
“Test Execution Summary by Test Suite Folder - Chart” - Displays the execution summary for all test suite folders with count of executions for each execution status. This chart can be drilled to view summary of the subfolders.
“Test Execution Details by Test Suite Folder” report - Display the test execution details for all testcases executed in the test suites for the selected folder.
New system reports -
Build Execution Summary - Added under Execution Summary dashboard : This report displays test case executions against Build, for combination of Test suites and Platforms.
Count of Unique users by date - Added under Login Summary dashboard : This report displays unique number of users logged in daily.
Users last login details - Added under Login Summary dashboard : This report displays last login date and time for each user.
Execution Summary report will now display chart colors uniform and matching with the execution status colors.
Modify colors on your custom report charts as required.
Every report gadget header now has a reset filter option.
Improvements to Exploratory Testing
Capture browser Console and Network logs for a session that are helpful for developers to debug failed scenarios. The Console and Network events recorded during the session will be displayed on the Console and Network Tab for that session. These logs will also be added as attachments to the test case created from the session. The new chrome extension 1.0.6 has an option to record these logs.
Test case created from an exploratory session can now be linked to Requirements & Test Suites from the Exploratory testing screen. The workflow now allows testers to execute the test case by associating it to a test execution from within the session as an evidence of the tested use case.
Note
Release 8.6.2 upgrade requires to install/upgrade the latest version v1.0.6 of QMetry Test Management – Exploratory Testing extension on chrome browser.
Improvements to Jira Integration - QMetry Enterprise app
QMetry Test case panel in Jira for Story and Bugs now displays:
Latest test case execution status.
Section now has two tabs – Test Steps & Executions (New)
Execution Tab displays :
Test case executions for a combination of test suite, release, cycle, platform and executed version.
Linked Bugs and Test logs for the test executions.
Execution details like - Assigned to, Executed by, Executed on & Estimated time.
Test Steps tab – displays Test steps of the linked test case version.
Test case detail page in Jira now displays Execution & Test case details in separate tabs.
Execution tab displays :
Test case executions for a combination of test suite, release, cycle, platform and executed version.
Test case step execution details.
Linked Bugs, Test logs, Comments for the test executions and test step
Test case details displays complete test case information.
Bugs linked directly to requirements in QMetry will now appear in Jira Story “Issue Link” section.
Note
Release 8.6.2 upgrade requires to install/upgrade the latest version v2.0.7 of Jira Integration - QMetry Enterprise App in Jira. For customer using Jira Cloud the add-on will be auto-upgraded to the latest version.
Miscellaneous Improvements
System Admins can now regulate project administrators access with more granular permissions for create, modify, delete, clone for projects.
Audit logs now include events for user details like activation, deactivation, role assignments & authentication type changes.
Export Test Suite Summary details (without test cases and steps) from Test Suite module using option “Export Test Suite List Summary View”.
Now expand the folder structure panel to easily view long folder names.
Execute dependent or independent multiple parallel API calls with Json Batch Support.
While importing automation test cases using Automation API, test cases with summary length truncated to 255 characters can be imported, by setting new "skipWarning" parameter to 1.
Server installations : System Administrator can now trigger data sync for custom reports, check the sync progress and download logs from Insights configuration screen.
Server installations : System Administrator now have an option to disable auto deletion of audit, change and test result logs and retain then forever.
Bug Fixes
Fixed a bug that prevented deactivating a project, if it was the last logged in project for a deleted user.
Fixed a bug that prevented removing user access from a project, if it is the last logged in project for the user.
Fixed a bug that displayed mandatory reporter field as optional while creating a Jira issue from QMetry.
Fixed a bug that displayed workflow statuses from non-integrated Jira projects while creating/searching issues.
Fixed a bug that prevented loading My Dashboard for some users due to internal duplication of dashboard ids.
Fixed a bug that prevented syncing of Jira issue if priority field is not set in any of the synced Jira issues.
Fixes a bug that prevented loading My Dashboard if Jira username for reporter/assignee contains single quote.
Fixed a bug that prevented freezing grid header row while scrolling records in a page, across the product.
Summary of Open Rest API Changes
API Name | REST URL | Method | Backward Compatible to 8.6.1 | Request Changed | Response Changed |
List all builds | /rest/admin/drop/list | POST | Yes | No | Yes |
Create build | /rest/admin/drops | POST | Yes | Yes | No |
Get Test Suite Run IDs | /rest/execution/list/platformHome | POST | Yes | No | Yes |
Reset execution statuses on build updates | /rest/execution/resetstatus | POST | Yes | Yes | Yes |
Get List of Fields | /rest/admin/managefield/list | POST | Yes | Yes | Yes |
List Test Case Executions | /rest/testcases/execution | POST | Yes | No | Yes |
Fetch Testcase Run ID | /rest/execution/list/viewColumns | POST | Yes | No | Yes |
Get List of Users | /rest/admin/user/list | POST | Yes | No | Yes |
Bulk Update Run Status | /rest/execution/runstatus/bulkupdate | PUT | Yes | No | Yes |
Create Project | /rest/admin/project | POST | Yes | Yes | No |
Get List of Execution Statuses | /rest/admin/execution/list | POST | Yes | Yes | No |
Build 8.6.1.2 - Release Date: 2020-06-05
Bug Fix
Fixed a bug that caused advanced query reports to give no output when opened in edit mode.
Build 8.6.1.1 - Release Date: 2020-05-07
New Features and Improvements:
Improved Custom Reporting - QMetry Insights, with two views:
Visual Report – Allows business users to create simple to complex custom report gadgets by just drag & drop of fields from pre-defined entity views. Easily apply group by, sort, filter & multiple math operations on report columns while creating gadgets.
Advance Query Report – Allows users to create & execute SQL based custom reports using the Query Builder which has an entire snapshot of the QMetry data synced and accessible from just 15 tables.
General Usability Improvements
View and Copy SQL queries for Visual & Advanced owned/shared gadgets to create your own gadget report.
Export graphical gadgets to png, jpeg, SVG vector image, PDF; chart data to XLS & raw reports data to csv.
Quickly clear applied filters using the new "Reset" button on gadgets.
Easily "Select/Unselect All" list values available to filter gadget reports.
Turn on/off summary at row/column level in custom cross table report.
Enhanced filters to search on multiple values of text columns.
Improvements to System Reports:
Individual filters are now available for system reports gadgets replacing earlier consolidated filter.
Filter requirements and test cases by their folders while generating traceability report.
System gadget reports can also be exported to png, jpeg, SVG vector image, PDF, chart data to XLS, raw reports data to csv.
Quickly clear applied filters using the new "Reset" button on gadgets.
"Select/Unselect All" list value options now available to filter gadget reports.
My Dashboard & System gadget reports will now allow selecting inactive users while generating reports and view their assignments.
Export now available for "Test Result Log" report" in xls and csv format.
General usability improvements :
Default pagination can now be increased up-to 100 records per page.
Project Keys can now be up to 5 characters in length with support for numbers and certain special characters.
On enabling SAML authentication, the QMetry URL will auto redirect to the SSO provider login page instead of the QMetry login page.
Bug Fixes
Fixed a bug that could stop auto syncing of reports data if emoji characters were encountered in requirements synced with Jira.
Fixed a bug that prevented making the reporter selection mandatory while creating bug from QMetry to Jira.
Fixed a bug that prevented test suite UDF fields to be displayed in bulk edit if modify customization permissions were off.
Fixed a bug that prompted SAML authenticated user to change password, when the authentication type is changed from QMetry to SAML.
Fixed a bug that prevented syncing of Jira issues in some cases when issue type of already synced issue is changed.
Fixed a bug that prevented display of change log and combined view for test cases which had text with characters unrecognized by utf8 character set.
Fixed a bug that could cause slowness/downtime if about 1 million test cases are exported with steps.
Fixed a bug that prevented export of parent test case key column when the child test cases are exported.
Fixed a bug that did not capture audit log for the project rename event.
Jira Integration - QMetry Enterprise App Changes
Release 8.6.1.1 upgrade requires to install/upgrade the latest version v2.0.5 of Jira Integration - QMetry Enterprise App in Jira.
Rest APIs changed, added and deprecated
None
Build 8.6.0.3 - Release Date: 2020-04-03
Summary: Improvements and Bug Fixes
Bug Fixes
Fixed a permission issue that prevented sharing custom dashboards and gadgets with other users.
Fixed a bug that skipped syncing those Jira issues for which Jira APIs did not respond with data within 60 seconds.
Fixed a bug that caused some test case/steps contents to overlap making it unreadable when exported in a PDF.
Fixed a bug that displayed Releases and Cycles in custom gadgets selection filters for the Projects users do not have access to.
Fixed a bug that prevented proper display of rich text data in large text fields.
Fixed a bug that showed incorrect timestamps for added comments.
Fixed a bug that changed the assignee and reporter fields in QMetry issue module for some of the synced Jira issues.
Fixed a bug that prevented bulk export of custom fields along with other Test suite fields when export with all fields option is selected.
Build 8.6.0.2 - Release Date: 2020-03-16
Summary: Improvements and Bug Fixes
New Features and Improvements:
Introduced all New Custom Reporting Module - QMetry Insights, which contains a database schema that is separate from the actual QMetry transactional database and is available for users to write/execute custom queries. The reports DB schema has an entire snapshot of QMetry DB in just 15 tables synced real time that makes the query creation simple. Here is the list of features –
Create custom 'Gadgets' using the new Query Builder with auto suggest feature that makes query creation easy.
Reuse gadgets for multiple projects by adding default QMetry filters while creation.
Share gadgets with specific users or all users of a specific role, project combination.
Create your own 'Dashboards' with multiple gadgets chosen from system, custom owned or shared gadget repositories.
Share dashboards with other users or schedule them as email notifications one time or recurring.
Share view only dashboards outside QMetry using Embedded URLs.
Export dashboard graphical gadgets to PDF and tables/cross table gadgets to csv.
Export table/cross table gadgets on a dashboard via Open Rest API’s.
Improved copy test suites feature by introducing more flexible options.
Copy with associated platforms, test cases & executed version for selected test case execution statuses.
Copy with the existing execution status or reset them to not run.
Copy with the current executed version or force sync test cases to latest versions.
Copy all associations with Release/Cycle and Platforms.
Copy with all the assignment or unassign executions.
Link test assets by providing entity keys separated by comma. Also, skip duplicates optionally to prevent them from being linked again.
Link Test cases to Test suite using Test case Entity Keys.
Link Test cases to Test suite using Requirement Entity Keys.
Link Test cases to Requirement using Test case Entity Keys.
Link Requirements to Test case using Requirement Entity Keys.
Link Test suites to Test case using Test suite Entity Keys.
Link Requirements to Issue using Requirement Entity Keys. (Only for Internal Issue Module - QMetry Issues)
Bulk execute screen is revamped and is now more powerful with the following new options.
Execute/Assign test cases to 20 platforms on a single window without scrolling. Limited maximum selection to 20 Platforms at a time.
Select independent test case cells for execution/assignment.
Select test cases for a specific platform using column selection.
Test case columns with details like entity key, summary, order will be frozen and will not scroll along with the platforms horizontally.
Bulk options will now be displayed as separate buttons.
View complete Test case summary and Platform summary on mouse hover.
A new gadget "Test Execution Assignments" is added on My Dashboard.
This gadget displays all the test case executions assigned to a tester for a unique combination of Project, Release, Cycle, Platform, Test suite, Test case & Executed Version.
This gadget allows testers to view their Pending and Executed test case assignments by filtering them on Execution Status, Project, Release, Cycle.
Testers will be directly taken to the execution screen by clicking on "Execute" button for the respective test case run.
Improved Project Clone.
Admin user will be able to view the clone process started by any user.
Clone process now automatically ends after 8 hours of inactivity in process and will unlock the source project.
User will be allowed to edit custom queries when a project is being cloned.
New System Report to view test execution summary "Platform Summary By Test Suites" - The reports displays execution summary of the test case runs for a combination of Platform and Test suites.
Entity Keys will now be auto mapped during reimport of Test cases.
Filter Platforms on Created date range and Created By while linking them to test suite.
Performance Improvements
Jira Integration - Project configuration and Syncing Jira issues.
Release selection while creating a Cycle.
API to List Releases.
Assigning user access to a Project.
Compatibility with MYSQL 5.7.29 community edition.
Customers who have not bought the “Advanced Reports – Custom Reporting” would now not need a separate reporting server to run the system reports.
Bug Fixes
Fixed a bug that did not preserve test case status filter while linking test case to test suite.
Fixed a bug that did not display test result logs for test case steps on previous executed version when test results are imported using Automation API.
Fixed a bug that caused test case step order to display incorrectly on the execution screen for certain test suites having very large number of steps and associated with multiple release & platform.
Fixed a bug that displayed duplicate issue statuses in the status list while searching available issues to be linked on execution screen, for projects integrated with Jira.
Fixed a bug that prevented integration with Jira Projects having Kanban boards.
Fixed a bug that displayed incorrect count of linked test cases on Test Suite List view.
Fixed a bug that prevented creating/syncing Jira issues when priority does not exist/optional Jira field.
Jira Integration - QMetry Enterprise App Changes
Release 8.6 upgrade requires to install/upgrade the latest version v2.0.4 of Jira Integration - QMetry Enterprise App in Jira.
If upgrading from v8.5.4 below to 8.6 - Post upgrade mandatory sync of Jira integrated projects is needed to display all the mapped Jira fields in the new Issue module.
Deprecated Features
Visual analytics reporting - Ability to create custom reports using drag and drop columns. - This feature is being redesigned and will be added back in 8.6.1 - April 2020.
All existing custom gadgets and dashboard needs to be recreated using QMetry Insights. QMetry Support team will assist to create few sample reports, however any existing custom gadgets and dashboard will not be migrated as is.
Rest API Changes
API Name | REST URL | Method | Backward Compatible 8.5.6.1 | Request Change | Response Change |
|---|---|---|---|---|---|
Copy a Test Suite | /rest/testsuites/copy | PUT | Yes | Yes | No |
Get list of Test Suites for a Test Case | /rest/testsuites/list/forTC | POST | No | No | Yes |
Link Requirement(s) with Test Case | /rest/testcases/link/requirement | PUT | Yes | Yes | No |
Link Test Case(s) to Requirement | /rest/requirements/link/testcases | PUT | Yes | Yes | No |
Link Test Suite(s) to Test Case | /rest/testcases/link/testsuites | PUT | Yes | Yes | No |
Link Test Case(s) to Test Suite | /rest/testsuites/dolink/TCs | PUT | Yes | Yes | No |