HARD-TO-AUTOMATE RESULTS
Jump to navigation
Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
.................................................................................................................Main Page / Back to Design Issues / Back to Test Automation Issues
.................................................................................................................Main Page / Back to Design Issues / Back to Test Automation Issues
Issue Summary
Preparing the expected results is slow and difficult
Category
Design
Examples
- Results can only be compared on the GUI
- Results are spread through different databases or media and it's difficult to put them together in a meaningful way
- Results change randomly
- Results change from release to release
- Results depend on what test cases have been run before
- API or AI tests deliver non-predictable results
Questions
How complex are the automated test cases? Can they be split up?
Are complex "scenario" test cases really necessary?
Resolving Patterns
Most recommended:
- FRESH SETUP: apply this pattern if you have issues like Example 5
- DEDICATED RESOURCES: look up this pattern if you have to share resources
- THINK OUT-OF-THE-BOX: try to look at the problem from unusual viewpoints. This is especially important for issues like Example 6
- WHOLE TEAM APPROACH: if your team follows an agile development process this is the pattern to use in order to avoid this kind of problems from the beginning
Other useful patterns:
- SHARE INFORMATION: use this pattern for better communication between development, testing and automation
- DESIGN FOR REUSE: this pattern should be used always
- COMPARE WITH PREVIOUS VERSION: this pattern helps when nothing else does
- TAKE SMALL STEPS: this pattern is always useful
.................................................................................................................Main Page / Back to Design Issues / Back to Test Automation Issues