Difference between revisions of "UNREALISTIC EXPECTATIONS"
Jump to navigation
Jump to search
m (Topic titles in capital letters) |
m (empty lines removed) |
||
| Line 1: | Line 1: | ||
| − | <div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Management Issues]] / Back to [[Test Automation Issues]]</span | + | <div id="content_view" class="wiki" style="display: block"><span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Management Issues]] / Back to [[Test Automation Issues]]</span> |
=<span style="font-size: 16px">'''Issue summary'''</span>= | =<span style="font-size: 16px">'''Issue summary'''</span>= | ||
| − | + | <span style="font-size: 16px">There are unrealistic expectations regarding what test automation can and cannot deliver.<br /> <span style="font-size: 16px">Usually it is managers who have unrealistic expectations for automation - sometimes they are hoping for a "silver bullet" that will solve all of their problems.</span><br /> <br /> <span style="font-size: 16px">However, others may also have unrealistic expectations. For example, testers may believe that automated tests will "notice" things that a human being would notice, or developers may think that tests will "automate themselves" and testers are not needed to identify which tests are best to automate.</span> | |
=<span style="font-family: Arial; font-size: 16px">'''Category'''</span>= | =<span style="font-family: Arial; font-size: 16px">'''Category'''</span>= | ||
| − | + | <span style="font-family: Arial; font-size: 16px">Management</span> | |
=<span style="font-family: Arial; font-size: 16px">'''Examples of unrealistic expectations'''</span>= | =<span style="font-family: Arial; font-size: 16px">'''Examples of unrealistic expectations'''</span>= | ||
| − | |||
| − | |||
# <span style="font-family: Arial; font-size: 16px">Every single (manual) test case can and should be automated.</span> | # <span style="font-family: Arial; font-size: 16px">Every single (manual) test case can and should be automated.</span> | ||
# <span style="font-family: Arial; font-size: 16px">Even if the SUT is changed almost daily, the tests should be automated (now).</span> | # <span style="font-family: Arial; font-size: 16px">Even if the SUT is changed almost daily, the tests should be automated (now).</span> | ||
| Line 15: | Line 13: | ||
# <span style="font-family: Arial; font-size: 16px">Maintenance of automated tests will not be needed, or has a very small cost.</span> | # <span style="font-family: Arial; font-size: 16px">Maintenance of automated tests will not be needed, or has a very small cost.</span> | ||
# <span style="font-family: Arial; font-size: 16px">Managers don't understand that introduction of test automation introduces a parallel development process and thus increases cost.</span> | # <span style="font-family: Arial; font-size: 16px">Managers don't understand that introduction of test automation introduces a parallel development process and thus increases cost.</span> | ||
| − | |||
=<span style="font-family: Arial; font-size: 16px">'''Questions'''</span>= | =<span style="font-family: Arial; font-size: 16px">'''Questions'''</span>= | ||
| − | + | <span style="font-size: 16px">What do managers expect that automation will do for the company?</span><br /> <span style="font-size: 16px">What sources have they used to find out about automation?</span><br /> <span style="font-size: 16px">What do they see as the limitations of automation?</span><br /> <span style="font-size: 16px">What investment do they think is still needed in automation?</span><br /> <span style="font-size: 16px">How will they measure the benefits of automation?</span> | |
=<span style="font-family: Arial; font-size: 16px">'''Resolving Patterns'''</span>= | =<span style="font-family: Arial; font-size: 16px">'''Resolving Patterns'''</span>= | ||
| − | + | <span style="font-family: Arial; font-size: 16px">Most recommended:</span><br /> | |
| − | |||
* <span style="font-family: Arial; font-size: 16px">[[SET CLEAR GOALS]]: Apply this pattern if you still have to begin. If you are already automating, take a step back and apply this pattern so long until everybody has the same understanding of test automation</span> | * <span style="font-family: Arial; font-size: 16px">[[SET CLEAR GOALS]]: Apply this pattern if you still have to begin. If you are already automating, take a step back and apply this pattern so long until everybody has the same understanding of test automation</span> | ||
* <span style="font-size: 16px">[[DO A PILOT]]</span><span style="font-family: Arial; font-size: 16px">: When the automation effort hasn't started yet, apply this pattern to clarify what automation can and cannot do, what resources you will need (tools, people) etc.</span> | * <span style="font-size: 16px">[[DO A PILOT]]</span><span style="font-family: Arial; font-size: 16px">: When the automation effort hasn't started yet, apply this pattern to clarify what automation can and cannot do, what resources you will need (tools, people) etc.</span> | ||
* <span style="font-size: 16px">[[SHARE INFORMATION]]</span><span style="font-family: Arial; font-size: 16px">: This pattern is useful to resolve this issue if you are already in the thick of test automation. If people believe any of the things in the list above of unrealistic expectations, you will need to educate them to explain why this is not realistic.</span> | * <span style="font-size: 16px">[[SHARE INFORMATION]]</span><span style="font-family: Arial; font-size: 16px">: This pattern is useful to resolve this issue if you are already in the thick of test automation. If people believe any of the things in the list above of unrealistic expectations, you will need to educate them to explain why this is not realistic.</span> | ||
| − | + | <br /><span style="font-size: 16px">Other useful patterns:</span><br /> | |
| − | |||
* <span style="font-family: Arial; font-size: 16px">[[TAKE SMALL STEPS]]: Use this pattern to show what can realistically be achieved within a short time frame such as a single Sprint</span> | * <span style="font-family: Arial; font-size: 16px">[[TAKE SMALL STEPS]]: Use this pattern to show what can realistically be achieved within a short time frame such as a single Sprint</span> | ||
<br /> <span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Management Issues]] / Back to [[Test Automation Issues]]</span></div> | <br /> <span style="font-size: 14px">.................................................................................................................[[Main Page]] / Back to [[Management Issues]] / Back to [[Test Automation Issues]]</span></div> | ||
Revision as of 17:05, 7 May 2018
.................................................................................................................Main Page / Back to Management Issues / Back to Test Automation Issues
.................................................................................................................Main Page / Back to Management Issues / Back to Test Automation Issues
Issue summary
There are unrealistic expectations regarding what test automation can and cannot deliver.
Usually it is managers who have unrealistic expectations for automation - sometimes they are hoping for a "silver bullet" that will solve all of their problems.
However, others may also have unrealistic expectations. For example, testers may believe that automated tests will "notice" things that a human being would notice, or developers may think that tests will "automate themselves" and testers are not needed to identify which tests are best to automate.
Category
Management
Examples of unrealistic expectations
- Every single (manual) test case can and should be automated.
- Even if the SUT is changed almost daily, the tests should be automated (now).
- There is no need to spend time developing a framework - the manager bought you the tool, now just get on with it.
- When automated tests pass, it means there are no defects in the software.
- Running an automated test the first time automatically gives Return on Investment (even if it takes 10 times longer to automate the test than it would to run it manually).
- Any manual tester can write automated test cases directly in the tool scripting language.
- Maintenance of automated tests will not be needed, or has a very small cost.
- Managers don't understand that introduction of test automation introduces a parallel development process and thus increases cost.
Questions
What do managers expect that automation will do for the company?
What sources have they used to find out about automation?
What do they see as the limitations of automation?
What investment do they think is still needed in automation?
How will they measure the benefits of automation?
Resolving Patterns
Most recommended:
- SET CLEAR GOALS: Apply this pattern if you still have to begin. If you are already automating, take a step back and apply this pattern so long until everybody has the same understanding of test automation
- DO A PILOT: When the automation effort hasn't started yet, apply this pattern to clarify what automation can and cannot do, what resources you will need (tools, people) etc.
- SHARE INFORMATION: This pattern is useful to resolve this issue if you are already in the thick of test automation. If people believe any of the things in the list above of unrealistic expectations, you will need to educate them to explain why this is not realistic.
Other useful patterns:
- TAKE SMALL STEPS: Use this pattern to show what can realistically be achieved within a short time frame such as a single Sprint
.................................................................................................................Main Page / Back to Management Issues / Back to Test Automation Issues