Difference between revisions of "OBSCURE TESTS"

From Test Automation Patterns
Jump to navigation Jump to search
(Created page with "<div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.........................................................................................")
 
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
<div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Design Issues]] / Back to [[Test Automation Issues]]</span><br />  
+
<div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Design Issues]] / Back to [[Test Automation Issues]]</span>  
=<span style="font-family: Arial; font-size: 16px">Issue summary</span>=
+
=<span style="font-family: Arial; font-size: 16px">'''Issue summary'''</span>=
<span style="font-family: Arial; font-size: 16px">Automated tests are very complex and difficult to understand</span><br /> <br />  
+
<span style="font-family: Arial; font-size: 16px">Automated tests are very complex and difficult to understand</span>  
=<span style="font-size: 16px">Category</span>=
+
=<span style="font-size: 16px">'''Category'''</span>=
 
<span style="font-size: 16px">Design</span>
 
<span style="font-size: 16px">Design</span>
=<span style="font-family: Arial; font-size: 16px">Examples</span>=
+
=<span style="font-family: Arial; font-size: 16px">'''Examples'''</span>=
 
 
 
 
# <span style="font-family: Arial; font-size: 16px">Manual testcases have been automated as is, that is they depict long scenarios that build on each other</span>
 
# <span style="font-family: Arial; font-size: 16px">Manual testcases have been automated as is, that is they depict long scenarios that build on each other</span>
 
# <span style="font-family: Arial; font-size: 16px">Automated scripts or data are not modular, are not documented and are stored with cryptical names, so that they practically cannot be reused</span>
 
# <span style="font-family: Arial; font-size: 16px">Automated scripts or data are not modular, are not documented and are stored with cryptical names, so that they practically cannot be reused</span>
Line 12: Line 10:
 
# <span style="font-size: 16px">Keywords have been implemented, but never maintained, so that nobody really knows what they do</span>
 
# <span style="font-size: 16px">Keywords have been implemented, but never maintained, so that nobody really knows what they do</span>
 
# <span style="font-size: 16px">The automated test cases try to test too much all at the same time. This makes the tests not only slower, but also more fragile because they can fail in parts that actually have nothing to do with the original test</span>
 
# <span style="font-size: 16px">The automated test cases try to test too much all at the same time. This makes the tests not only slower, but also more fragile because they can fail in parts that actually have nothing to do with the original test</span>
<br />
+
=<span style="font-family: Arial; font-size: 16px">'''Questions'''</span>=
=<span style="font-family: Arial; font-size: 16px">Questions</span>=
+
<span style="font-family: Arial; font-size: 16px">Who is doing the automation? A "lone hero"?</span><br /> <span style="font-family: Arial; font-size: 16px">Who is writing the automation test cases?</span><br /> <span style="font-family: Arial; font-size: 16px">Are there standards? If yes, are they used?</span>  
<span style="font-family: Arial; font-size: 16px">Who is doing the automation? A "lone hero"?</span><br /> <span style="font-family: Arial; font-size: 16px">Who is writing the automation test cases?</span><br /> <span style="font-family: Arial; font-size: 16px">Are there standards? If yes, are they used?</span><br /> <br />  
+
=<span style="font-family: Arial; font-size: 16px">'''Resolving Patterns'''</span>=
=<span style="font-family: Arial; font-size: 16px">Resolving Patterns</span>=
 
 
<span style="font-family: Arial; font-size: 16px">Most recommended:</span><br />  
 
<span style="font-family: Arial; font-size: 16px">Most recommended:</span><br />  
 
 
* <span style="font-size: 16px">[[ DOCUMENT THE TESTWARE]]: Use this pattern for issues similar to Examples 2. 3. or 4.</span>
 
* <span style="font-size: 16px">[[ DOCUMENT THE TESTWARE]]: Use this pattern for issues similar to Examples 2. 3. or 4.</span>
 
* <span style="font-size: 16px">[[DOMAIN-DRIVEN TESTING]]: use this pattern to enable even non-technical testers to write and review test cases for automation</span>
 
* <span style="font-size: 16px">[[DOMAIN-DRIVEN TESTING]]: use this pattern to enable even non-technical testers to write and review test cases for automation</span>
Line 28: Line 24:
 
* <span style="font-family: Arial; font-size: 16px">[[TOOL INDEPENDENCE]]: use this pattern if you don't want everybody on the team to become a tool specialist</span>
 
* <span style="font-family: Arial; font-size: 16px">[[TOOL INDEPENDENCE]]: use this pattern if you don't want everybody on the team to become a tool specialist</span>
 
<br /> <span style="font-size: 16px">Other useful patterns:</span><br />  
 
<br /> <span style="font-size: 16px">Other useful patterns:</span><br />  
 
 
* <span style="font-size: 16px">[[DESIGN FOR REUSE]]: using this pattern forces the team to develop readable and maintainable testware</span>
 
* <span style="font-size: 16px">[[DESIGN FOR REUSE]]: using this pattern forces the team to develop readable and maintainable testware</span>
 
* <span style="font-size: 16px">[[INDEPENDENT TEST CASES]]: apply this pattern to get rid of issues like Example 1.</span>
 
* <span style="font-size: 16px">[[INDEPENDENT TEST CASES]]: apply this pattern to get rid of issues like Example 1.</span>
Line 34: Line 29:
 
* <span style="font-size: 16px">[[KILL THE ZOMBIES]]: this pattern helps you clean up your scripts</span>
 
* <span style="font-size: 16px">[[KILL THE ZOMBIES]]: this pattern helps you clean up your scripts</span>
 
* <span style="font-size: 16px">[[LEARN FROM MISTAKES]]: apply this pattern in order to transform your bad experiences in learning experiences</span>
 
* <span style="font-size: 16px">[[LEARN FROM MISTAKES]]: apply this pattern in order to transform your bad experiences in learning experiences</span>
* <span style="font-size: 16px">[[MAINTAIN THE TESTWARE]]: this pattern is necessary as soon as you want to use your automation for more then a quick fix</span>
+
* <span style="font-size: 16px">[[MAINTAIN THE TESTWARE]]: this pattern is necessary as soon as you want to use your automation for more than a quick fix</span>
 
* <span style="font-size: 16px">[[OBJECT MAP]]: This pattern helps you develop scripts that use readable names </span>
 
* <span style="font-size: 16px">[[OBJECT MAP]]: This pattern helps you develop scripts that use readable names </span>
 
<br /> <span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Design Issues]] / Back to [[Test Automation Issues]]</span></div>
 
<br /> <span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Design Issues]] / Back to [[Test Automation Issues]]</span></div>

Latest revision as of 13:54, 28 June 2018

.................................................................................................................Main Page / Back to Design Issues / Back to Test Automation Issues

Issue summary

Automated tests are very complex and difficult to understand

Category

Design

Examples

  1. Manual testcases have been automated as is, that is they depict long scenarios that build on each other
  2. Automated scripts or data are not modular, are not documented and are stored with cryptical names, so that they practically cannot be reused
  3. Automation scripts are written in the proprietary language of the current tool and testers cannot read and much less run them
  4. Keywords have been implemented, but never maintained, so that nobody really knows what they do
  5. The automated test cases try to test too much all at the same time. This makes the tests not only slower, but also more fragile because they can fail in parts that actually have nothing to do with the original test

Questions

Who is doing the automation? A "lone hero"?
Who is writing the automation test cases?
Are there standards? If yes, are they used?

Resolving Patterns

Most recommended:


Other useful patterns:

  • DESIGN FOR REUSE: using this pattern forces the team to develop readable and maintainable testware
  • INDEPENDENT TEST CASES: apply this pattern to get rid of issues like Example 1.
  • KEEP IT SIMPLE: this pattern is always recommendable!
  • KILL THE ZOMBIES: this pattern helps you clean up your scripts
  • LEARN FROM MISTAKES: apply this pattern in order to transform your bad experiences in learning experiences
  • MAINTAIN THE TESTWARE: this pattern is necessary as soon as you want to use your automation for more than a quick fix
  • OBJECT MAP: This pattern helps you develop scripts that use readable names

.................................................................................................................Main Page / Back to Design Issues / Back to Test Automation Issues