Difference between revisions of "EASY TO DEBUG FAILURES"
Jump to navigation
Jump to search
(Created page with "<div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.........................................................................................") |
|||
| (2 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Execution Patterns]] / Back to [[Test Automation Patterns]]</span> | <div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Execution Patterns]] / Back to [[Test Automation Patterns]]</span> | ||
| − | =<span style="font-size: 16px">Pattern summary</span>= | + | =<span style="font-size: 16px">'''Pattern summary'''</span>= |
<span style="font-size: 16px">Each test failure should make it obvious which test failed and what went wrong. It shouldn't take hours to figure this out and it shouldn't require a rerun of the test.</span> | <span style="font-size: 16px">Each test failure should make it obvious which test failed and what went wrong. It shouldn't take hours to figure this out and it shouldn't require a rerun of the test.</span> | ||
| − | =<span style="font-size: 16px">Category</span>= | + | =<span style="font-size: 16px">'''Category'''</span>= |
<span style="font-size: 16px">Execution</span> | <span style="font-size: 16px">Execution</span> | ||
| − | =<span style="font-size: 16px">Context</span>= | + | =<span style="font-size: 16px">'''Context'''</span>= |
<span style="font-size: 16px">This pattern is useful for big and small automation undertakings.</span> | <span style="font-size: 16px">This pattern is useful for big and small automation undertakings.</span> | ||
| − | =<span style="font-size: 16px">Description</span>= | + | =<span style="font-size: 16px">'''Description'''</span>= |
<span style="font-size: 16px">Develop simple clear well documented tests. Design the automated test so that it keeps track of the information you would want to know when the test fails, for example, capture screen shots on a regular basis, or log all messages that are output, or record all the input data in one place. Automate the clear up such that all the test results and associated information is available in one place and is easily accessible to the person investigating the reason for the failure.</span> | <span style="font-size: 16px">Develop simple clear well documented tests. Design the automated test so that it keeps track of the information you would want to know when the test fails, for example, capture screen shots on a regular basis, or log all messages that are output, or record all the input data in one place. Automate the clear up such that all the test results and associated information is available in one place and is easily accessible to the person investigating the reason for the failure.</span> | ||
| − | =<span style="font-size: 16px">Implementation</span>= | + | =<span style="font-size: 16px">'''Implementation'''</span>= |
<span style="font-size: 16px">How to implement this pattern depends on your context. Here are some suggestions:</span><br /> | <span style="font-size: 16px">How to implement this pattern depends on your context. Here are some suggestions:</span><br /> | ||
| Line 16: | Line 16: | ||
* <span style="font-size: 16px">if you write [[SINGLE PAGE SCRIPTS]] you will know at a glance in which page or window the failure occurred</span> | * <span style="font-size: 16px">if you write [[SINGLE PAGE SCRIPTS]] you will know at a glance in which page or window the failure occurred</span> | ||
* <span style="font-size: 16px">and last but not least: [[KEEP IT SIMPLE]]!</span> | * <span style="font-size: 16px">and last but not least: [[KEEP IT SIMPLE]]!</span> | ||
| − | =<span style="font-size: 16px">Potential problems</span>= | + | =<span style="font-size: 16px">'''Potential problems'''</span>= |
<span style="font-size: 16px">If you do need to rerun your tests for better checking, implement [[ ONE-CLICK RETEST]]</span> | <span style="font-size: 16px">If you do need to rerun your tests for better checking, implement [[ ONE-CLICK RETEST]]</span> | ||
| − | =<span style="font-size: 16px">Issues addressed by this pattern</span>= | + | =<span style="font-size: 16px">'''Issues addressed by this pattern'''</span>= |
<span style="font-size: 16px">''[[HARD-TO-AUTOMATE]]''</span><br /> ''<span style="font-size: 16px">[[INEFFICIENT FAILURE ANALYSIS]]</span>'' | <span style="font-size: 16px">''[[HARD-TO-AUTOMATE]]''</span><br /> ''<span style="font-size: 16px">[[INEFFICIENT FAILURE ANALYSIS]]</span>'' | ||
| − | =<span style="font-size: 16px">Experiences</span>= | + | =<span style="font-size: 16px">'''Experiences'''</span>= |
| − | <span style="font-size: 16px">If you have used this pattern, please | + | |
| + | <span style="font-size: 16px">If you have used this pattern and would like to contribute your experience to the wiki, please go to [[Feedback]] to submit your experience or comment.</span><br /> <br /> | ||
| + | |||
| + | <span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Execution Patterns]] / Back to [[Test Automation Patterns]]</span></div> | ||
Latest revision as of 16:02, 21 August 2018
.................................................................................................................Main Page / Back to Execution Patterns / Back to Test Automation Patterns
Pattern summary
Each test failure should make it obvious which test failed and what went wrong. It shouldn't take hours to figure this out and it shouldn't require a rerun of the test.
Category
Execution
Context
This pattern is useful for big and small automation undertakings.
Description
Develop simple clear well documented tests. Design the automated test so that it keeps track of the information you would want to know when the test fails, for example, capture screen shots on a regular basis, or log all messages that are output, or record all the input data in one place. Automate the clear up such that all the test results and associated information is available in one place and is easily accessible to the person investigating the reason for the failure.
Implementation
How to implement this pattern depends on your context. Here are some suggestions:
- develop tests with ONE CLEAR PURPOSE: if such a test fails it will be easier to understand why
- implement INDEPENDENT TEST CASES: in this way you can be sure that the failure is not caused by an earlier test
- if many tests are failing for the same (minor) bug, implement EXPECTED FAIL STATUS
- if you write SINGLE PAGE SCRIPTS you will know at a glance in which page or window the failure occurred
- and last but not least: KEEP IT SIMPLE!
Potential problems
If you do need to rerun your tests for better checking, implement ONE-CLICK RETEST
Issues addressed by this pattern
HARD-TO-AUTOMATE
INEFFICIENT FAILURE ANALYSIS
Experiences
If you have used this pattern and would like to contribute your experience to the wiki, please go to Feedback to submit your experience or comment.