Categorie:
Ferramentas de teste de automação /
Katalon Studio Reveja
Excelente | |
Boa | |
Média | |
Mau | |
Horrível |
Katalon Studio is a powerful automation solution with a comprehensive and integrated set of features from recording test steps, generating scripts to executing and reporting test results for Web, API, Mobile & Desktop app test automation. It has been widely adopted by a global community of users and is recognized as a top automation tool.
Katalon's principle leeway is that it's anything but difficult to convey and has a more extensive arrangement of reconciliations contrasted with Selenium, the market head. Katalon has double scripting interfaces for clients with various programming aptitudes. This implies analyzers with restricted specialized learning can utilize a less difficult UI that doesn't require composing code.
Cons of utilizing Katalon Studio Absence of scripting dialects Not open source Documentation update slacks Execution issues
The beginner friendly aspect of this software makes it great for anyone to begin testing right away. Having the option of capturing browser actions without the need to necessarily having to write the script from scratch made it very straightforward to use. At the same time, having the option to easily customize the script makes it very flexible and helps get necessary testing done quickly.
The only issue I've ran into while using this software was some bugs when testing on certain browsers. At one point I had some issues when attempting to run a test on Safari due to some driver issues. There are also some small bugs when running tests on Internet Explorer with window sizing. There were some workarounds for these issues and I was still able to test on all browsers.
Fácil de usar
Object Recognition is a bit clumsy. It needs a spy that will give relative XPath for objects. Currently it gives a full Xpath which is unreliable.
The software can be easily customized to our needs, it’s intuitive, flexible and user friendly even for those who don’t know much about code. The recording is a good option to complete tests if you don’t have a good API
It needs improve on handling generation of jars each time an API is written. It also needs better handling of errors sometimes it’s nit clear. The profiles approach conflicts sometimes when checking changes into a remote repository since many users can change them. Better organization on the test cases / test suites
Was able to automate most of the manual testing work using Katalon studio. Thus saving time and efforts and putting those to use in more productive work.
It crashed many times without saving the changes I did.
Integration with Zephyr test management on Jira is missing. This is very much required as per Katalon test users. But not sure whey team have not come up with solutions for this. I hope they come up ASAP.
The Record mobile app feature, that allows easy recording, and very effective to perform stress test on mobile apps
somethings still have to be updated/saved manually for every test e.g i have to always set "uninstallAfterClose to false" everytime i run my test
Easy to use and merge all needs automated testing in one environment.
its to heavy. i hope it will more light and more faster when run start at first time
User friendly UI, support team's response and openness to suggestions, one tool for multiple tasks
It could be more dynamic in terms of recommending error / corrections
How easy it is to get started and put it to real use not just some dummy project.
Updates that require browser updates also.
Recorder Functionality
Independent Project Structure - can access one project at once , reuse ability ofkeyworkds become less
Ability to re-use test cases, to group selectors, web APIs, scripts with full programming capabilities, the capability to run on various platforms and browsers, debug, ability to integrate with GitHub, trigger test via batch scripts, HTML reports
Not supported on Linux, slow to trigger test, no hightlight on web element interacted with.
The software is easily setup and implemented. It is great that I can automate Web, Mobile and API's all with in one tool set.
The forum responses from Katalon are very slow if there is a response at all.
Takes time to load.
The ability to integrate with the latest & most generally used tools for deployments & development.
I have to keep check of the Chrome versions that the tool supports!
the recording feature is awsome and the test suite is also good keywords are easy to remember overall working is easy
least i like the creation of new keywords
1. Parallel Execution
1. Uses more System memory
It allow to somebody with no or little coding knowledge to get started in test automation with its intuituous interface and built in keywords. Also, with all the integration with various platforms and technologies make it a very easy to integrate tool in the day to day work environment.
Some glitches still exist in some fields such as soap api calls where not all endpoints are loaded correctly and some improvemetns could be done in order to completely replace soap ui usage in my case. Also the cucumber integration doesn't seem to have all the solution's benefits working correctly such as tags and others that could be added. Finally the Database that is internal could allow to clone, copy, delete or manipulate data easily even the search is not there to make a query for instance.
Excellent interface, great support and tutorials, installation is easy.
Some elements are difficult to pick up in the automation process.
The best about Katalon is that test cases can be created easily using the visual interface (katalon recorder), but can later be made more powerful using the scripting tools. It's also great to be able to export them and reimport them easily, allowing our team to collaborate adding new test cases with each passing version. We haven't yet integrated katalon with Jenkins, but knowing that its possible is great for us.
It took a bit of learning at first, since we used other tools before, but once that was done it's relatively easy to use. The community of users is not that large, but its apparently greowing since users from selenyum are mostly migrating to katalon. We've had some performance issues with it, and some cross browser differences, however, this didn't happen often.
It could have just been the application I was trying to automate, but it seemed like for most objects I had to go in an manually update the xpath. The xpath recorded didn't seem to work. I think this tool is pretty easy to use for basic test cases, but once you get into more complicated test cases it can get very cumbersome. I had good luck setting up the cases for my web application, and once they are set up the run with no problem. However, I had 0 luck setting up the mobile device testing. Again, it could have been the application itself, but there were a lot of extensions I needed to install in order to even get the device to plug in. Once I did, the point and click functionality did not seem as user friendly as the web application point and record functionality.
The tool can be used to test the following:
Since this tool is somewhat new in the market compared to Selenium Webdriver, hence, its at times difficult to find solutions if a user is stuck in a problem. However, the KS developers tries their level best to find the suitable solution for you as early as possible.
There is not anything to dislike currently as I have only been using it for about 6 months now.
Testing web and mobile app is very much easy by this tool. The automation procedure is great. The UI is great. Test data management and recording of test generation are the features of Katalon I love the most.
The tool is not a open source and the worst thing I've come across that is works on groovy. I would like to seen more coding languages added to the software. I've also encountered some lag while using this platform on my laptop.
UI of the application can sometimes be a bit of a problem.
what I like the most is that it is free, allows you to run tests with the most famous browsers and allows you to execute different types of languages, in addition you can program without writing
I would like you to be able to use languages like php and javascript and integrate with api to run automated tests
What I like the most is how easy it is to use Katalon. The functionality of the product is simple and easy to use. Also, the documentation that Katalon has is really impressive and useful.
The integration of Katalon Analytics isn't the greatest. A lot of the times Katalon Analytics doesn't show all of the information from my test suite. Also, my test suite doesn't always show in Katalon Analytics or it takes a long time to update with my results.
Updates for the software could be with errors when tests couldn't be executed. Or with changes like "to create a pdf report please install the add on". I don't like such changes when some of the functionalities suddenly stop working.
Configuração rápida
UX of application
Newer version of Katalon Studio has moved some of the free features to paid (ex. Jira integration)
What I like about this software is the fact that I can perform API, Web UI, and Mobile Applications testing all in one suite. I like the fact that the software is based on Eclipse, Java, and Selenium, and comes with all the drivers ready to go. It makes life easier for me who have to deal with a lot of the more technical components, but allows others on our team, who aren't as technical, drag and drop my scripts using the UI provided. I like the fact that the software encourages the Page Object Model and also makes Cucumber much easier.
You guys are making improvements on your reporting tool, but it used to be a major headache. Other than that, no major headaches.
I've been working with Katalon Studio for about 8 months now and have been very impressed with it's capabilities, rivaling other tools I've used that cost a boatload in annual license fees. The ability to test both API calls and UI fills a need for the projects we are working on. Continually updated and fantastic support forum. Easy to use in manual or scripted mode, I moved from manual tests to scripted quickly thanks to many great tutorials and thorough documentation!
The UI can be a smidge clunky at times and test suite organization and report output needs some enhancements. I am sure these areas are probably on their roadmap, however, and will be addressed in the coming year. They are very amenable to feedback.
Learning curve is relatively quick and easy to get going with your first few basic tests. There is also a lot of documentation out there if you get stuck on something.
The design is horrible. It feels like interacting with an app built in the early 2000s. BUT, it works well.
Ease of Use and operate. With basic training any one can start creating test scenarios in feature files and automatically respective code gets generated.
Frequent updates and paid JIRA and other plugins
1. Non-technical testers can use it with the same ease as technical members.
1. Support more languages other than Groovy
Difficult with dynamic id's and when we try to build a suite of tests the results are not the real ones. Example: 10 tests individually they pass when I try a build them all in a suite 80% of them fail. This is very boring.
Easy to set up and configure. Easy to record steps either manually capturing the element/s or using the SpyWeb/recordWeb features.
Hard to understand the errors and how to fix them. Although there is the katalon online community to seek for any help, it is not easy to pose the issue across where one can totally understand the question and come up with solutions.
I love the recording feature of the software that allows me to quickly create object repositories or just do a step by step of the website I test.
The documentation of Katalon could be more robust and descriptive. There are a couple things I've tried to do that I had to figure out on my own because the documentation wasn't clear
The pros of the application are without doubt the number of platforms that it covers and does it very very well.
Not a lot of cons to be honest, the learning curve was steep for people on the manual side to testing, however after some they did get adjusted to things and are regular users of the application.
It is very easy to use. Test cases can be made in very less time. offers a lot of other options apart from web UI testing like web service testing, desktop application testing etc.
the only con is that they release new version every 15 days, it becomes a problem to stick with one version as there are many bug fixes and new feature update.
I really love how easy it is to create objects and reuse on multiple sites. The copy/paste/move up/move down options are super easy to use. This makes it easy to maintain our work and make it fun to consistently use.
Its very difficult to troubleshoot issues. We've started keeping very detailed documentation about which errors may occur and when. If it weren't for that, I'm not confident our QA team would be able to understand how to fix/get past whatever is happening. I would really like to see clearer notes as to why something would be causing an error.
it an all in one solution and easy to use you can write your test scenario scripts easily and run it in no time it's really a very powerful testing solution.
None, all is good for me I didn't face any cons. till now
1. Any API related to Full screen capture of Web page is not introduced.
- Reporting for BDD tests should be improved. It should display more meaningful information about the steps performed in a readable way (BDD test looks actually more meaningful than a report - that is weird).
Overall, the experience with record-play-customize code-replay has is reminiscent of its more expensive counterpart/s. But overall it's better than the other automation tools i used so far. online help and resources are bountiful. Object repository, test collection, input data files are some of my favorite places to work around with. there are other features which i havent explored yet, like mobile and API automation.
There are certain customizations that i need with the software which are not yet supported (like full-page web screenshot and data file output), so our team is left to the care of old-school programming gurus on the web. the features that i miss is not a deal-breaker though, work arounds are fine by me for now.
Well organized and easy to use. For APIs its straight forward
Mobile UI automation is quite tough to setup. Android automation, once we make a script using the a particular mobile using the recorder, we were not able to use it on another model phone. When recording, the ids which the Katalon Studio is creating were changing for the next phone and hence it is not recognizing the on other phones. On the Iphone UI automation, most of the Iphones are not getting recognized. We spent 2 months on doing research and it is pretty inconsistent. Finally we moved just to Appium and manually create the scripts which is the reliable solution from years.
1- that you can use cucumber scripts along with groovy for automating test cases
1- you can not open more than one project at a time
Very fast to get up and running. Fits a variety level of users, flexible enough to allow advanced users to pretty much setup how they please at the same time enough of all the base needs for the new user. With it being free product, they update it regularly and are very attentive to user requests. Their application is actually fun to use. The setup and options are intuitive. Not hard to figure out how to do and implement even more complex, complicated operations with custom code. Very portable. The install being as isolated from the code, can easily install on another machine, and open project and be running tests, no special build, or install requirements to do this as I've seen in other tools.
Not a fan of the Object Repository handling, doesn't do well of detecting dupes, can get quick messy if user of the object spy. The code repository integration is basic, the interface to it not very robust. Its scripting language is Groovy, which is not as popular as others.
Somewhat easy to get started (see cons), Git integration, beginner and expert modes. Ability to export and continue with other IDEs if desired to go outside of the tool (not locked in to it forever).
A little cumbersome to setup all the needed plugins. Until everything is configured just right, you will run in to errors here and there that take time to troubleshoot. Test case navigation/folder structure could use a few more options and customization capabilities to be able to sort things better. Automatic centralized location for code and test case storage (similar to ALM) would be great. Having to commit and pull code each time from different stations is cumbersome. To schedule remote execution you must make sure the machine pulled latest code which is an issue if execution and development PCs are different.
I really like that Katalon is both similar to using Selenium and Quick Test pro. This is a fantastic marriage of the best features those products offered separately. It is also great to be able to save objects into a reusable repository and to be able to save request/responses and global variables. It makes it easier than trying to maintain request in files on your system. The use of Groovy, similar to QTP using VBScript, makes it easy to run tests in a more programmatical manner, allowing for loops and conditionals. Overall I find it extremely useful and I have recommended it to and prepared a training video for everyone on my team
One thing that Selenium had handled well was the conversion of HTML recorded tests to JUnit specifically which is something that seems absent from Katalon, and the conversion between the Browser Plugin recording and the tests created in the IDE seem to be incompatible. Memory does seem to be an issue, as I have trouble running Katalon along with other Java-based IDEs. I have also had trouble recording objects in the IDE, where certain form objects (e.g. select/combo boxes) use the contents as the default name, and in my case, caused the object name to exceed the character limit. forcing me to rename all my objects and keep track of what I had named them, which was a bit tedious. Also, the integration with Jenkins seems confusing.
It's packed with features, which comes in handy when you want to perform many tasks with one single tool.
The UI is a bit clunky, not very intuitive, and I guess the word is "overpopulated". There are many options, buttons, dropdowns, popups, which can be confusing.
I love the fact that I can do web scraping without having to write a million lines of code. I can just get on Katalon and do what I have to do. Customer service is great. They get to my questions right away when I write them on the forum which really helps. Overall great open source product and I'd recommend it to anybody.
Never really got a good answer on how to handle dynamic ID's. When the ID is static and stays the same, the code remains the same. But when I try to handle dynamic ID's, it will only remember the static one I input. I believe this is more of a user error than anything, but that's one answer that I never got.
1. Integrations with GIT, Bitbucket, Slack
1. Better to have options to connect multiple databases with windows auth mode
I used this product for automating the testing of our website. It was very easy to use as people who did not have a lot of coding experience could also use it easily. Its a one stop shop for web mobile and api which is very useful for companies who use all three platforms
More languages to be supported. I hate the fact that we are restricted to java groovy
We still needed to implement some standard ways of how we save, write and organize our test suites. Katalon could provide some guidelines or templates to help in this effort.
1-Less configuration.
Minimal or zero angular support
- As the title suggests, Katalon is very easy-to-use. The UI is very intuitive to use and therefor it doesn't take much time to get started. - Katalon comes with a lot of built-in features like a test recorder, that saves your interaction with a given UI-Interface and creates a test case out of it or a very nice way to save GUI elements and to organize test data via built-in databases. - Katalon is also very easy to use by non-programmers and therefor also a powerful tool for manual testers, to automate repetitive and boring tests. Nevertheless the quality of ones katalon repository will be much higher, when a experienced coder is working with it - but I would even consider this as "criticism", as other tools lack of user-friendly-interface for non-coders completely. - Katalon get's updated frequently and therefor grows in it's features - they just enabled the feature to share custom keywords, which is amazing!
- It's fairly young and therefor lacks of features like distributed testing (it still gets a lot of updates). - I had some performance issues with 4K monitors - the tree that is generated when executing a test takes a lot of performance. - The GUI repository is file based -> That means it will throw errors, if the file structure gets too long...
Object capturing can still be problematic. To efficiently use the tool, it helps to have solid grasp of how to target objects in the DOM with either via xpath or css attributes. This can present challenges for the business user occasionally.
Katalon is easily one of the best open source software tools for GUI automation testing. Its intuitive interface requires a minimal learning curve and with the official documentation online, someone with zero testing/coding experience can write a comprehensive test. Test suites and collections allow enterprise level testing by allowing users to run numerous tests in series or parallel in different browser configurations.
Katalon is an excellent software, but it is not without its bugs. For convenience I will list them:
Full IDE with; CSS/mobile element inspection, debugging tools, and built-in logging for tests.
The user interface feels slow at times.
Since its built on Top of Selenium working on Katalon becomes way too easy for a new user as well. On the other side if you have worked on Selenium and Java. You can master it in few days. And Never Forget the Spy web and record web button helps you to find such complex x-path which would be a tough task doing it manually. And testing of API , and UI is an easy task like never before.
1. Integrate it with Chro path for better xpaths.
Ease of use. Easier for manual testers as well as automation testers/developers.
Still lot of room for improve Documentation should improve Copying variable across call test cases is bit difficult and time consuming
With advanced technology, high-quality applications are now inevitable. Manual testing of applications also slows down this rapid process. Considering the different factors such as slowness as well as multi-platform support, cross-browser, responsive design and more, an application's manual test may leave you with unexpected complications and extra efforts.
I don't think it is very useful for web service and API testing.
Every automation tool has some drawbacks, but I managed to nd workarounds for each
- The record& playback feature help those QA who doesn't have programming language also can do automation testing.
- A lot of issue found when executed the test in command prompt, because I use Jenkins to trigger the test
Powerful tool but easy to use and simple to deploy
Paid support
It is very user friendly and has loads of functionalities that makes automation testing look so easy and simple.
I would prefer that they have some more extensibility for desktop app like java apps, spring etc
Katalon have good feature of record and play back which avoids script for the tester.
Windows testing is not available in Katalon.
It is convenient and integrated with Selenium and Appium. It almost has all the features what Sele/App have. Besides, it has its own defined methods which can be used very efficiently to do the testing work. For example, which you want to scroll to a certain text, all you need to do is use scrollToText() without handling the XY coordinate. I truly thank Katalon for making my work easier!
I think one feature I am not satisfied is handling the webview in mobile apps. I know there is a method in Katalon which allow us to switch from native apps to webview. But it seems like it does not work for me. When I post the question in forum, I did not get the solution neither. Currently I am working on testing hybrid apps with webview in it. I hope one day you can fix this.
Ease of Use - This is one of the most reason I like this tool as it makes everyone as automation engineers that includes manual testers and subject matter experts
Integrations with performance test automation. Though it is a different area but needs to think on how can a single test case be used for various purpose that includes performance testing tool
I liked that there are many nice tutorials available online that got me running with using the software. Not being a power user, it was very nice to be able to start with a recorder for my first tests and then have the ability to add code as needed.
The one thing I found a bit frustrating was that when I updated to a new version of the software, some tests stopped running. I'm not sure what was the reason for this, but once I went back to the older version all was fine. So, in the world of automated testing, it was a bit hard to realize the issue was with the new version and not with my tests.
Switching between creating scripts or just design the test flow which then converts itself into scripts is an amazing feature. This also helps people in the team who are not familiar with creating scripts to understand scripting
Sometimes there is an inconsistency between different Operating Systems and browsers. Test cases do fail randomly.
I have been using Katalon Studio for almost 6 months now. I have been evaluating the product to see how it can help us in out Test Automation. I love the simplicity of Katalon Studio but at the same time it is a very powerful tool. I love how the project is organized into different meaningful folders. Also, I love how you can switch from manual mode to script mode to further expand the test scripts.
One thing that I don't like about Katalon Studio is its restrictiveness to writing scripts using Groovy and Java. I wish the team could expand further and allow other languages such as Python and C#.
Recorder and Playback for beginners, Keyword Driven for intermediates, or Java/Selenium Webdriver for advanced usage.
Growing community, but still in its infancy
In built framework, no need to create your own.
No much community support. Product still evolving. Paid support is expensive Newer version and new feature along with bug fixes are frequent.