Categorie:
Software de desenvolvimento de aplicativos /
TestRail Test Case Management Reveja
TestRail Test Case Management
Avaliações: 75 | Classificação geral: BoaExcelente | |
Boa | |
Média | |
Mau | |
Horrível |
Boost your software testing with scalable, customizable test case management. Efficiently manage manual and automated test cases, plans, and runs. Get real-time insights into testing progress with informative dashboards, metrics and activity reports plus email notifications. Integrate with your issue tracking and/or test automation software to trigger tests and share results. Install on your own server or choose our cloud-based/SaaS solution. Available in standard and enterprise editions.
performance issue for large company & heavy users
Can be a little tricky to get the project set up and configured at first but soon becomes intuitive
Valuable reports (that's the main purpose of testing)
There is no integration with confluence (to get bubbles like for JIRA defects/tasks)
Super easy to use and organize test cases. It works great and allows multiple structures depending on how your team manages test cases
The reporting capabilities are extremely limited. There are some canned reports that you can tweak. We struggle to find what we need without a custom report. You cannot download them as PDF. You need to download them as HTML which is not ideal in most work place scenarios. We can get most of the info we need from the dashboard, but it would be nice to download as a pdf to excel/csv.
It would be nice to have a tool to do automated testing
The software's very integrated with JIRA
They could improve testing matrixes, reporting like KPIs, Test Coverage, and really need a link between requirements/stories and code coverage.
One of the items we wanted to use was the Jira integration. However, due to our corporate policies and firewall issues, we are not able to integrate. We use the cloud version of Jira. This is not the fault of the TestRail integration piece but was a con for our us. by Gurock Software on 02/02/2018 Thanks so much Glen for taking the time to complete this review. TestRail Team
It's a great tool to keep track of test cases, who created them, who modified. Great for keeping track what step passed and what failed. Making sure everything is recorded for future reference.
The one thing that I would like to see in TestRail is a standard report that will list each test case, with steps for a specific project, or milestone. This type of report would make it much easier to provide user acceptance tests to clients and responses to any auditing queries. by Gurock Software on 20/01/2018 Thanks so much from the TestRail team Piyush for taking the time to complete this review.
An interface that undoubtedly facilitates each of the processes in the realization of the tests in an optimal way, in addition to creating the follow-ups of each of the tests that we have, in addition to offering good reports as well as the aspects and functionalities are customizable in relation to the projects you are working with.
It should be more specific in terms of the explanation of the functions that exist, since some are but are not taken advantage of since the details are not given in the benefits of their use of the rest meets the needs.
At first the price seems a little on the high side but we did not really have a frame of reference. It now seems like a fair investment in quality assurance and peace of mind.
User Friendly, Simple UI. Report creation is easy.
Searching ability can be expanded to include more parameters. Sometimes cannot find a test case.
Building and maintaining test suites is easy and intuitive.
There are certain features that the community have asked for that Gurock either aren't planning to do or are taking a long time to implement.
The Test Cases Organization and flexibility to create tests. The possibility to add custom fields and that after, you can filter by those fields
The way the Test plans are managed, there is no easy way to delete tests from a given configuration in a test plan and the reporting is very basic, not allowing Leads or managers to see progress for individuals by Gurock Software on 20/01/2018 Thanks so much from the TestRail team Sergio for taking the time to complete this review.
No special support for BDD ( Behaviour Driven Development)
Appreciate easy integration with JIRA, this allows us to map test cases to JIRA task & defects. Test plan is another feature which we appreciate. It allows us to track our progress on milestones. Adding additional attributes to test cases also helped us to resolve some requirements like multi level reviews. Configuration is another option which we have used extensively.
A direct integration with Confluence could be appreciated. We have always felt that tester needs to navigate to JIRA and to confluence to review any requirement change. As confluence is a widely used documentation tool and direct integration with the same would be widely appreciated.
1) Ability to carry out test runs and then pull matrices/graphs representing history/trend of the bug count in a particular feature
Nothing that I missed desperately while using the tool.
This tools helps us to organize the testcases and testplan. Adds lot of visibility to the entire team and it’s reporting is very useful
We can’t add testcases in the testplan across different project. Each platform has its own project so when we want to combine the common cases in one testplan, it doesn’t provides us the way.
Some of the admin was a bit cumbersome when we first started such that there wasn't a good split between the person that administers the accounts and who pays for it.
To be toothful I do not have any major complaint with the product. Small annoyances my be cleanup after test runs. by Gurock Software on 11/07/2018 DaleThanks so much for taking the time to do this, much appreciated.TestRail Team
The ease of use and the integration with JIRA.
Some of the report generations were slow to produce and the initial setup on the server edition was involved.
An intuitive tool that help to create a test case in an easy and pleasant way
Importing Test Cases from csv could be easier
*customized for any project
* can easily make it complex for others depending on how you setup
-TestRail provides easy management of test-suites, test-cases, test-runs. Easy management for maintaining agile methodology in the project.
- Test results should be editable as required in some cases.
The reporting part is nice and easy to use. I can generate reports fast and I have the possibility to schedule the reports and to save them in a .pdf format for example.
It is not cheap but also not expensive. The price per value is right.
1- versatility to create Projects which allow base line Test Cases to be used in a variety of different test runs for different products.
The main issue I have is the Projects are listed as a flat-file. We have several different groups which have created Projects and even though they might be testing a given entity from different sides, they have to name their Projects differently. We prefix each project with a Group Name so the Projects can be "grouped" and easily referenced from the main dashboard.
I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal. Integration with Jira is excellent, although some room for improvement.
Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal.
This tool helped me in keeping a track of each and every QA activity.
The price is too high. I am planning to buy some more licenses but the price is very high
Ability to use the API to link our automated test our manual test cases.
Bulk closing of test runs would be great, and the reporting could be a little better.
I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility!
It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library.
- This is the receipt of real-time test results (creating reports on completely different criteria: Defect Summary, Comparison for Cases, test results for projects / components, etc.)
As one of the drawbacks - until recently, Test Report system was poorly implemented reporting system: scant results on test-wounds, lack of customization of reports, etc.
Easy to learn how to use
Copying content could be easier to perform
For me the biggest advantage of using TestRail was its JIRA integration. Ability to create, edit and manage testcases as well as testsuites is amazing
Eventhough this check almost all the right boxes, i was never a fan of the reports generation feature. This could have been implemented better with customisation features. Also, the pricing is a bot harsh for individual users.
I would like to have a feature that exports via email all the execution results from the test cases.
Versatile allows you to start projects in multiple styles of SDLC agile to waterfall
the fact that you have to code to extend - the reporting tools out of the box are lacking
- Very easy to use, the team was using it full time within 1 week
- It would be nice if TestRail included bug tracking functionality, but it just integrates with other tools
Fácil de usar.
.csv file import system and reporting system requires improvement.
Easy to configure and use projects, testsuites and testcases. Can manage all projects independent. Integrations are easy for automatize testruns executions .
I miss some integrations with others tools.
Testrail is a good product for QA and PM to track the the testing progress
They give us percentage of testing progress, summary test report, easy to report about the testing result.
1) Configuration of the tool is a bit too rigid. I would make it more streamlined and have some admin features for configuration made available for regular users
This software has been key in our regression testing. This helps us make sure our applications core features continue working as we add features. The API is great to use to for our automated testing.
There is a learning curve on the terminology I feel. Test Runs And Test Suites and Test Plans etc. It makes sense after a while but takes some getting used to.
Missing possibility to set default tester per test case.
It's highly customisable and very easy to pickup and understand.
The reporting capabilities are limited on the SaaS version.
Easier test cases and execution management
a reviewer type user would be good, the one that wouldn't need license.
Search function should have been a bit more inclusive. Not able to search in multiple projects.
Easy to write test cases and manage test cases.
I have used test link and switched to testrail.There is nothing much to say about it, it is a great tool to manage tests.
First of all, TestRail is an extremely smarter way to track and maintain test cases than using Excel. I like how easy it is to create new projects, create custom fields, create test runs, and generate good looking reports to submit to your managers. The GUI takes a little bit to get used to, but once you get a hand of all of the key-shortcuts moving around the application is easy!
My least favorite part about this software is the JIRA plug in. In order to see the linked test cases from TestRail in JIRA, you need to have a TestRail account. In my company only the testing team had TestRail accounts, while the rest of R&D didn't. While it was helpful for me as a tester to see the linked test cases on a JIRA bug, when we started off with TestRail we had assumed everyone in the R&D department would be able to see this information so we could be more transparent in our testing. My company was not willing to pay for 100 TestRail accounts, so this was a bummer. If yours is then TestRail might be right for you!
TestRail's simple UI and functionality is straight forward. Easy for people to jump in and use the tool, assuming that the tool fits Dev/QA's team workflow and method of usage. For the administrator, access is easily manageable, and provides multiple categories for restricting access and defining user roles within the organization.
TestRail is no different than other test management systems, beside the front end and UI benefits. TestRail is good for teams who initiate test planning, test case creation, and management specific to older QA management styles. When introducing continuous integration testing into a development/QA' teams methodology, this is where TestRail needs improvement . TestRail does not do a good job logging individual test runs for historic tracking, DB backend cannot handle the data that is pushed to the system, and we often have to delete DB records to help with performance and lookup. Usually without these backend hacks, the system performs very poorly and is slow. TestRail may be good for teams that have not adopted advanced development and QA practices, but if teams want to integrate CI testing with test cases and suites within TestRail this is where we find it to fail.
Can't search and replace words in multiple test cases at the same time which makes it harder to re-use existing test cases with only small changes
Easy and simple way to build a QA process, plus it's web-based, easy to admin, and has a simple UX that even our QA co-ops can follow for manual test. Has scaled well with our team.
Not much to not like. Works as advertised but doesn't seem to tie easily into automated testing, maybe that could be an add on in future.
Right off the bat the software is very easy to use The software allow us to manage our time effectively focussing on running regression tests on any particular task. It has been a useful tool for our Quality Assurance team to prioritize and organize test cases. The fact that we can implement the use of Jira is also a huge plus since this is a tool we also use within our organization.
Not many cons, the only two minor aspects that come to mind are one if you have no knowledge of how to use it does take some time to learn it. However if you have even the basic background on a tool like this the learning time does shorten. The other is the fact that results can only be shared with the registered users, so we are having to take screen shots of results to share with the rest of our company teams.
It would be helpful to have more examples of how to realize the effectiveness of Milestones versus Test Runs and creating Test Case Templates. All of these are configurable within the UI however it takes a lot of trial and error to find how to make use of these features to best effect. Fields can be customized but some of the choices for required fields seems unnecessary, such as "Estimate" for test case. Adding the option to enter a "Description" or "How to Use This Field" for custom fields would be a useful addition as well.
- managed in cloud
- some reports are complicated to get, as who worked on what in the past quarter
Good way to organize test plans, cases and runs
nothing much. may you can support hippa complaint could offering?
TestRail is powerful yet easy to learn and use. It is extremely flexible and we have not encountered any application of it that was not a perfect fit. It has been widely adopted by our QA and Dev teams.
There are some admin features that could be easier such as managing users and grouping them for team access and policy rights.
The ability to have reporting at a higher level across all projects within TestRail. Need to have a better manager level view of everything.
- fácil de usar
- design is outdated and could be a bit more intuitiv
- clean interface
- so as much as it is adaptable by doing so it also makes it not the strongest tool since it needs to support many different styles
Out company uses TFS and integration with TFS is not very good. The best we can do is link a failed test to a TFS dev task, and it only goes 1 way.
All the test cases at one place. Easy to create and execute runs. Simple reports are easy to add and use as test evidence. Ability to use runs for multiple releases at the same time
Pre-built reports. Can not customize much . No multi-select for the test cases ( cannot use shift select). Unable to update test definition from the test runs
The only complaint I have is that when writing a test case by steps, adding a next step is a little cumbersome. It would be nice it there was an alternate command like shift + arrow down to add another step rather than selecting the tiny "add step" link.
After several years in QA and using TestLink and other tools finally I was able to convince management to use TestRail. That was a game changer - easy to use for manual testing, integration with our automation flow and integration with JIRA saved us a lot of work days.
Sometimes I've experienced issue with JIRA integration (we were using Microsoft Active Directory and password to JIRA was changing each month)
Running test runs are sometimes a pain but you can still manage.
It's getting more expensive, especially when comparing 2018 to 2019 costs (47% increase)
We have not had any bad experience with the software.
Lack of some reports, like reports per build
It's a toss-up: how easy it is to create re-runs of tests and the ability to keep a history of test results.
It's probably a little too well-structured, which gives it a certain inflexibility when wanting to (for example) share test cases between projects.
Some functionality is not intuitive in the user interface, but not really a big deal.
- The system of test suites (a master list of all your test cases) and test runs (individual lists of specific test cases) is well-built and allows you to manage your test cases easily.
- There isn't a good tutorial for the product (or at the very least I never saw anything like a tutorial). As a result, it took me a while to notice some of the more unintuitive features.
The best thing about TestRail is their REST API. Thanks to it we were able to easily implement its integration with our test automation framework. In particular we were able to map test exucution statuses to TestRail test case statuses and allow updating them easily for test reruns. Second good thing is reports they allow to generate. That's what our managers wanted.
Sometimes UI is not intuitive. For instance, it took a while to figure out how to change test cases status in bulk.
- Intuitive UI system that allows you yo easily organize test suites, test runs, and projects.
- It can be quite expensive for small teams, but it's well worth it.
- The reporting features could be improved since it is very basic with no many customization options. by Gurock Software on 11/07/2018 Thanks so much for taking the time. Much appreciated..TestRail Team
Generating a test report requires lot of hands-on other than this i don't see any other cons in this tool. by Gurock Software on 20/01/2018 Thanks so much from the TestRail team Ankit for taking the time to complete this review.
The ease of use for this software has allowed our company to transfer from paper test sheets to logins for our end users. This test software had an answer and feature for every question we had.
There's very little to dislike about this software. The report extract is a bit clunky. When a report is emailed to an email address, it's sent as a zip file with an html file. The extra steps required to view a report eliminate the usefulness of this feature. by Gurock Software on 20/01/2018 Thanks so much from the TestRail team for taking the time to complete this review.
1. It is simple to login in. It takes your windows login/pwd
1. I have administrative right to deleted folder, cases etc. But I feel delete option could have a bigger icon. Many times I have to search the tiny red button.