Blog: Deeper Testing (2): Automating the Testing

Here’s an easy-to-remember little substitution that you can perform when someone suggests “automating the testing”:

“Automate the evaluation
and learning
and exploration
and experimentation
and modeling
and studying of the specs
and observation of the product
and inference-drawing
and questioning
and risk assessment
and prioritization
and coverage analysis
and pattern recognition
and decision making
and design of the test lab
and preparation of the test lab
and sensemaking
and test code development
and tool selection
and recruiting of helpers
and making test notes
and preparing simulations
and bug advocacy
and triage
and relationship building
and analyzing platform dependencies
and product configuration
and application of oracles
and spontaneous playful interaction with the product
and discovery of new information
and preparation of reports for management
and recording of problems
and investigation of problems
and working out puzzling situations
and building the test team
and analyzing competitors
and resolving conflicting information
and benchmarking…”

And you can add things to this list too. Okay, so maybe it’s not so easy to remember. But that’s what it would mean to automate the testing.

Use tools? Absolutely! Tools are hugely important to amplify and extend and accelerate certain tasks within testing. We can talk about using tools in testing in powerful ways for specific purposes, including automated (or “programmed“) checking. Speaking more precisely costs very little, helps us establish our credibility, and affords deeper thinking about testing—and about how we might apply tools thoughtfully to testing work.

Just like research, design, programming, and management, testing can’t be automated. Trouble arises when we talk about “automated testing”: people who have not yet thought about testing too deeply (particularly naïve managers) might sustain the belief that testing can be automated. So let’s be helpful and careful not to enable that belief.

Want to know more? Learn about Rapid Software Testing classes here.

4 responses to “Deeper Testing (2): Automating the Testing”

  1. Marius Francu says:

    Uouuu. Nice. I hope more testers to feel, understand, acknowledge and act accordingly to what you have said above.

  2. Jim Hazen says:

    Hmm… I like this. Over the years of working on “automation” of testing I’ve come to the point where, like you, have told people that all we are doing is using a tool to aid in the performance of a task. I tell people that 99% of the time when they talk about “test automation” that all they are covering is the “execution” (actually just using an execution engine) of a “test”. Sound reasonable? Because yes, there is so much more that we, the human, do in performing the actions of testing.

  3. […] Deeper Testing (2): Automating the Testing Written by: Michael Bolton […]

Leave a Reply

Your email address will not be published. Required fields are marked *