Showing posts with label ideas. Show all posts
Showing posts with label ideas. Show all posts

Wednesday, 29 January 2014

Using games to aid tester creativity

Recently Claire Moss  blogged about potty training and how this came about from a card game called Disruptus  I introduced to the Atlanta Testing meet up while I was in the USA.  This reminded me that I was going to blog about how I use this tool in a workshop and in my day to day testing to improve upon my own and teams testing ideas.  The workshop is a creative and critical thinking and testing workshop which I intend to deliver at the London Tester Gathering in Oct 2014 – early bird tickets available. 

The workshop is based upon a series of articles that I have written on creative and critical thinking part 1 here.  As part of the workshop I talk about using tactile tools to aid your creative thoughts, having objects you can hold and manipulate have been shown to improve creativity (Kinesthetic learning).  One part of the workshop introduces the game of Disruptus, which has very simple rules. You have about 100 flash cards which have drawings or photographs on and you choose a card at random. They even include some spare blank cards for you to create your own flash cards. An example of some of the cards can be seen below:



You then have a selection of action cards which have the following on them:
  •  IMPROVE
    • Make it better: Add or change 1 or more elements depicted on the card to improve the object or idea
    • EXAMPLE From 1 card depicting a paperclip: Make it out of a material that has memory so the paperclip doesn’t distort from use.
  • TRANSFORM
    • Use the object or idea on the card for a different purpose.
    •  EXAMPLE From 1 card depicting a high heel shoe: Hammer the toe of the shoe to a door at eye level and use the heel as the knocker.
  • DISRUPT
    • Look at the picture, grasp what the purpose is, and come up with a completely different way to achieve the same purpose.
    •  EXAMPLE From 1 card depicting a camera: Wear special contact lenses that photograph images with a wink of the eye.
  • CREATE 2
    •  Using 2 cards take any number of elements from each card and use these to create a new object or idea.
  •  JUDGES CHOICE
  •  PLAYERS CHOICE
For the purpose of this article I will only be looking at the first three.  You can either choose which action card you wish to use or use the dice that is provided with the game. The rules are simple you talk about how you have changed the original image(s) in accordance with the action card and a judge decides which is the best to decide the winner.  When I do this we do not have winners we just discuss the great ideas that people come up with, to encourage creativity there are no bad ideas.

The next step in the workshop is applying this to testing. Within testing there are still a great many people producing and writing test cases which are essentially checks. I am not going to enter into the checking vs testing debate here, however this game can be used if you are struggling to move beyond your ‘checks’ and repeating the same thing each time you run your regression suite. It can be used to provide ideas to extend your ‘checks’ into exploratory tests.  

Let us take a standard test case:
Test Case:  Login into application using valid username/passwordExpected result:  Login successful, Application screen is shown.
Now let us go through each of the action cards and see what ideas we can come up with to extend this into an exploratory testing session

  •  IMPROVE - Make it better: (Add or change 1 or more elements depicted on the card to improve the object or idea.)

Using the action described above can you think of new ways to test by taking one element from the test case?

Thinking quickly for 1 minute I came up with the following:
    • How we do start the application?  Is there many ways?  URL?  Different browsers? Different OS?
    • Is the login screen good enough or can it be improved (disability issues/accessibility)
    • What are valid username characters?
    • What are valid password characters?
    • Is there a help option to know what valid username/passwords are?
    • Are there security issues when entering username/password?
Can you think of more?  This is just from just stepping back for minute and allowing creative thoughts to appear.  (Remember there are no bad ideas)

Let us now look at another of the action cards.
  • TRANSFORM - Use the object or idea on the card for a different purpose.
What ways can you think of from the example test case above to transform the test case into an exploratory testing session?

Again we could look at investigating:
    • What alternatives are there to logging in to application? Fingerprint, Secure token, encrypted key?
    • Can we improve the security of the login code?
    • What security issues can you see with the login and how can you offer improvements to prevent these issues
It takes very little time to come up with many more ways in which you can transform the test case into something more than a ‘check’

Now for the next (and final for the purpose of this article):
  • DISRUPT - Look at the picture, grasp what the purpose is, and come up with a completely different way to achieve the same purpose.
I may have already touched upon some of the ideas on how to disrupt in the previous two examples, that is not a bad thing since if an idea appears in more than one area it could be an indication of an idea that may very well be worth pursuing.

Some ideas on disrupting could be:
    • Do we need a login for this? 
    • Is it being audited?
    • Is it an internal application with no access to the public?
I hope from this article you can see how such a simple game can help to improve your mental ability and testing skills, as Claire mentioned in her article.
Since software testing is a complex mental activity, exercising our minds is an important part of improving our work.
This is just a small part of the workshop and I hope you have enjoyed the article, if so I hope to see some of you soon when I run the full workshop. 

PS – I intend to run a cut down version of the workshop for the next Atlanta Testing Meet Up whilst I am here in the USA.  Keep a watch here for announcements in the near future.




Monday, 10 June 2013

Test Ideas Cue Cards

How often when we are testing do we get stuck or cannot think of new and novel ways to exercise the system?

After my recent set of posts on creative and critical thinking I started to think more and more about how we can improve our creative thinking.  So I decided to put together a bunch of cards that may help to improve your creative thinking using a mixture of quotes, pictures and heuristics testing cheats sheets. I cannot take full credit for the concept and idea since the idea is based upon some initial work by Karen Johnson of testing mnemonics as a card deck, many thanks to @karennjohnson for the ideas and for allowing to use them.

Some of the uses I have come up for them include:

  • Test planning sessions
  • Test interviews
  • When using exploratory testing and need a quick boost to aid creativity in your test 
  • In the test lab at a testing conference
  • Brainstorming sessions
I am sure you could come up with many more uses and if you do please let myself and Karen know.


The file contains the cards can be found as a PDF file using the following link: https://docs.google.com/file/d/0B8jc_cHKwbNocGdCM2JZdi03ZjQ/edit?usp=sharing

Added a word doc link for those who wish to edit the cards. (thanks to Duncan for the suggestion)



Wednesday, 30 January 2013

Something Old, Something New


"Be careful. People like to be told what they already know. Remember that. They get uncomfortable when you tell them new things. New things . . . well, new things aren’t what they expect. They like to know that, say; a dog will bite a man. That is what dogs do. They don’t want to know that man bites a dog, because the world is not supposed to happen like that. In short, what people think they want is news, but what they really crave is olds . . . Not news but olds, telling people that what they think they already know is true." 
TERRY PRATCHETT The Truth: a Novel of Discworld
This passage from the Terry Pratchett novel "The Truth" resonates very much with me especially when it comes to world of testing.  I see a connection with how different people in our craft react with each other when it comes to new ideas, thoughts and innovations.  There are those who embrace change and want to know more.  There are then those who like time to think critically and use different forms of reasoning before deciding if it is good or not.  Then there are those who dismiss out of hand anything new, anything that makes them feel uncomfortable or goes against their current beliefs.

My concern and the reason for this blog post is how within testing we can become more creative and innovative.  As one of my previous post stated I think to be creative we need to think about finding problems than trying to solve them.  Continuing on the path of our focus being only to solve problems restricts our creative thinking.  At the same time we need to find ways to convince those who dismiss anything new or unexpected.  To do this a set of guidelines should be introduced to encourage creative thinking rather than discourage:

• Those who easily dismiss new ideas should not be quick to be negative, negative comments and views are one of the easiest ways to destroy creativity.
“The creative impulses of most people can be suffocated by negative criticism, cynical put-downs or dismissive remarks.” 
Ken Robinson – Out of our Minds
• Company leaders need to lead from the top and encourage new ideas and innovation, making the task of thinking (creative and divergent) as important as other everyday tasks. They need to give time to allow this to happen.
“it’s not enough to think differently. We also have to act differently” 
Abraham Lincoln (Taken from  Ken Robinson – Out of our Minds)
• There is a need to encourage people to try, and to see failure and mistakes as learning opportunities. We should stop blaming and encourage risk taking to enhance the opportunities for serendipity moments.
“We don’t teach people how to deal with failure and this is a fundamental oversight.” 
Ken Robinson – Out of our Minds
• We need to have more diversity within teams, encourage people who may have different views to yourself to work with you.  Employ someone who thinks differently to you.  This gives more chances that new ideas will be generated from these differences.
“Such people will provide a wider range of knowledge from which to extract information and build upon ideas.” 
Why diversity is the mother of  creativity - Jeffrey Baumgartner
• Spend more on training the people who work with you or for you.  Take an interest in their learning, encourage, mentor, and support their creative needs.
 “Creative teaching requires moving from a focus on imparting knowledge to knowledge acquisition, providing opportunities for the learner to engage in deep thought and productive action.” 
Susan Keller-Mathers, Encyclopedia of Giftedness, Creativity, and Talent
• It is not enough to come up with new ideas; creativity involves doing something and applying your ideas.
"Innovation is the process of putting new ideas into practice. Innovation is applied creativity." 
Ken Robinson – Out of our Minds
Some may find this a strange post and wonder what it has to do with testing.  I see testing as a very creative process especially when it is unburdened from too much process and stifled by procedures.  Exploratory testing lends itself very easily to the creative process and encourages the tester to think and discover new and exciting ideas.  We need to do more of this style of thinking so we become more engaged with our creative side.  A few people over the past few years have been saying that testing is dead, I would say that the non-thinking uncreative tester is going to die out and become extinct  (The checking robots as some may classify them).  We need to encourage and develop working environments in which  people can connect to their creative side and be allowed the freedom to explore new ideas and not be afraid of making affordable small mistake from which they can learn.

I will leave you with one of my favourite quotes from the American poet Jack Kerouac,  It is OK to be different and to challenge the status quo we need to encourage more crazy ones into testing.
“Here’s to the crazy ones. The misfits. The rebels. The trouble-makers. The round heads in the square holes. The ones who see things differently. They’re not fond of rules, and they have no respect for the status-quo. You can quote them, disagree with them, glorify, or vilify them. But the only thing you can’t do is ignore them. Because they change things. They push the human race forward. And while some may see them as the crazy ones, we see genius. Because the people who are crazy enough to think they can change the world, are the ones who do.” 
Jack Kerouac

Wednesday, 12 December 2012

Problems and Creativity


I recently posted a tweet
When #testing should we be problem finders or problem solvers? Problem finders appears to think more creatively is this aligned to ET?
This started a few discussions with people tweeting that surely it is best as a tester to be both and that they see their role as being a problem finder and a problem solver.  Some took it that being a problem solver is better since you are looked on more positively.

Francesco @TesterSerendip
@steveo1967 @mpkhosla@JariLaakso @tonybruce77 hence better at finding bugs. Plus you are perceived as one with a positive mindset 
Other that they see themselves primary as problem solvers
Tony Bruce @tonybruce77
@steveo1967 I'm a problem solver, I approach the problem differently#testing
I then made the following tweet:
John Stevenson ‏@steveo1967
@mpkhosla @JariLaakso @TesterSerendip being in a problem finding mode may be better for a tester when testing since you may be > creative
My tweets came about after reading some books and articles on the following subjects


This led to me researching the concept that our mind-set within the field of testing appears to mainly be focused on problem solving and that our default state when testing is be in a 'problem solving' mode.  Very little focus or attention seems to have been placed on using our creative skills and entering a mind-set of being a problem finder.  The more I researched into this the more I felt that in some testing situations especially when doing testing practically we are missing opportunities to think more creativity and we are limiting ourselves when we approach testing with the mind-set of trying to solve problems rather than find problems.

One piece of information I related to was from *James Bach or Michael Bolton in how we should approach session based test management.  When in a session we should be looking for problems, creating new tests and noting things of interest which could be bugs.  We should focus on the opportunities and come back to find out if it is a bug/issue (problem solving exercise) after the session as finished.  The principle of this is if you stop to try and solve the problem you could lose track and focus and your creative thinking will become disrupted.  Einstein is quoted as saying the following:

“We can't solve problems by using the same kind of thinking we used when we created them.”
Which IMO matches the thoughts I have on the issue of problem finding and solving.  Yes we need both but they require different thinking.

This is the key point I was trying to make with my statement whilst we are testing in the context of actually being in a session our mind set should be on problem finding.  Having a mind-set focused on problem finding according to some articles has been proven to be more creative.

“Anyone who is technically proficient can solve a problem that is already formulated: but it takes true originality to formulate a problem in the first place (Einstein and Infeld, 1938).”

“…persons who are likely to innovate tend to have personality traits that favour breaking rules and early experiences that make them want to do so. Divergent thinking, problem finding, and all the other factors that psychologists have studied are relevant in this context.”
 http://www.sagepub.com/upm-data/11443_01_Henry_Ch01.pdf

“Csikszentmihalyi and Getzels (1971) found that originality was high related to problem finding and discovery oirientation”

“Getzels believed that creativity investigators should turn their attention to and examine problem finding in addition to problem solving”

“Many creative individuals have pointed out in their work that the formulation of a problem is more important than its solution and that real advances in science and in art tend to come when new questions are asked or old problems are viewed from a new angle . . . yet when measuring thinking processes, psychologists usually rely on problem solution, rather than problem formulation, as an index of creativity. . . They thus fail to deal with one of the most interesting characteristics of the creative process' namely, the ability to define the nature of the problem”

“We believe that this neglect of problem finding is a deficiency that is observable in the discourse on problem solving within technology education.”



What I am not saying is that we do not need to be problem solvers; this is part of our role.  I think the subject matter of this article is similar back to a previous article I have written on which mood we should be in to test software  and which gives us more benefit.

In some situations it may be better to be in a problem solving mind set and in others it may be better to be in a problem finding mind set.  Both have their merits.  What I feel I am trying to get across that if you need to create ideas and be innovative you need to have a mind-set that is looking at being a problem finder rather than a problem solver.   However if have a solution to a problem you may want to flip this around.  Then with a problem finding mind-set examine the solution for problems.

To conclude I will repeat what was said earlier by Einstein and Infield
“Anyone who is technically proficient can solve a problem that is already formulated: but it takes true originality to formulate a problem in the first place (Einstein and Infeld, 1938).”
I feel if there is one thing that people take away from this article it is that statement.

Further reading

  1. Out of our minds – Ken Robinson
  2. Perspectives in Creativity -   By Irving A. Taylor, Jacob W.. Getzels
  3. Wisdom: Its Nature, Origins, and Development – Robert Sternberg
  4. Perspective: Problem Finding and the Multidisciplinary Mind -  Linda Austin
  5. The Creative Vision: A Longitudinal Study of Problem Finding in -  J. W. Getzels, M. Csikszentmihalyi
  6. What's Holding You Back?: 8 Critical Choices for Women's Success -  By Linda Austin, M.D

* If anyone can direct me to a reference where this came from and it was not just a conversation I have had then please let me know.