Transcript Real Testing? At a Test Conference?!?

Real Testing? At a Test
Conference?!?
Kristoffer Ankarberg
Ericsson AB
@KrisAnkarberg
Content
The Test Lab Concept
The EuroSTAR Test Lab Story
What’s In It For Me?
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
The Test Lab
The Test Lab is a physical space organized for practicing testing with
guided exercises that allow you to experience the many aspects of testing
Items to test (typically freeware)
Puzzles
Bug tracking tool
Mind map tools
…
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Content
The Test Lab Concept
The EuroSTAR Test Lab Story
What’s In It For Me?
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
EuroSTAR Test Lab
2009
2010
2011
2012
Planned in advance
Speaker sessions
Moved into the Expo
2013
First Test Lab
Dedicated Area
(well hidden)
Sponsors
Team grew to 4
Testing Competition
100+ active testers
Tablets
Online testing
Test Lab Menu
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Team grew to 5
Test Lab Menu
1. Reporting corner. So you've tested. Report. We have a special
corner to do that for the widest selection of audiences. Practice makes
perfect, and this is a perfect thing to do after whatever you've tested in
the lab.
2. Test scenarios for usability. Create a few usability test scenarios
on the OpenCart, set things up you need and recruit someone to try
out your scenarios. How did you do on giving a good goal and what did
you learn about usability by watching the user?
3. Altom Black-Box Machines. The challenge is to find out their logic.
This is something we do with the software to test, finding plausible
explanations and forming theories to test.
4. Beer game. Go and try ordering a beer from one of our lab
personnel. You might be surprised about what you learn on
requirements by trying that out.
5. Cheat Sheet. Use cheat sheet to create new ideas. What more
would you test than first meets the eye?
6. Feature tours of OSCommerce and OpenCart.Find out what the
two open-source web shops have to offer, point out strong points and
limitations. Be the tester.
7. Isolate a bug on OpenEMR. The first experience with this
software's user creation is that it does not work, new user's login fails.
Can you make it work, and tell the conditions that make it fail in more
detail?
8. Lego Robot Challenge. Come check out the Lego Mindstorm
robots and play with them to find out what they do. We have two
robots, two puzzles and plenty of colors to test with.
9. Reproduce a bug. Someone logged bugs into database already.
Take one, and see if you can reproduce it. If it was missing info that
you found in the exercise, add a helpful comment.
10. Survey to deep coverage. Exploring has a structure. Choose a
system and test it long enough to try different types of testing.
11. Test for Error Messages on XMind. Here's an exerpt from code
of the error messages. Trigger error messages intentionally to test
them. What else would you do for covering concerns on this?
12. Test FreeMind Search and Replace. Here's a relatively new
feature with a specification. Anything to report?
13. Test the Boggle Cubes. A selection of white-and-red cubes to
play Boggle for you to explore. As a product delivered to you in a black
box with instructions, how would you test this? Does the product work?
14. Boosting bug reporting with pictures. Create a video of the
problem you find with http://www.screencast-o-matic.com/ and
compare that to taking screenshots with Greenshot. When would you
go from static pictures to moving images?
15. Burp Suite to security. Work with Burp suite (security testing
tool) to identify problems with openEMR.
16. Exploratory note taking. Try the iTester or Rapid Reporter to
document while you test.
17. First Robotium test from scratch. Create a test project and write
a first test using Robotium for Android WordPress mobile based on
NotePad example.
18. jMeter to performance. Set up your first performance test on one
of our test targets.
19. Leaking memory. Here's an challenge for you on WordPress for
iOS - find a memory leak.
20. SBE to automation on iOS. Write a test to start a new session
with iTester using Frank based on existing examples.
21. Selenium: recorded test / programmed test.Create a selenium
test case with selenium IDE. Then transfer that idea to be more
maintainable as test code in .net or java toolset.
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Test Lab Menu
1. Reporting corner. So you've tested. Report. We have a special
corner to do that for the widest selection of audiences. Practice makes
perfect, and this is a perfect thing to do after whatever you've tested in
the lab.
2. Test scenarios for usability. Create a few usability test scenarios
on the OpenCart, set things up you need and recruit someone to try
out your scenarios. How did you do on giving a good goal and what did
you learn about usability by watching the user?
3. Altom Black-Box Machines. The challenge is to find out their logic.
This is something we do with the software to test, finding plausible
explanations and forming theories to test.
4. Beer game. Go and try ordering a beer from one of our lab
personnel. You might be surprised about what you learn on
requirements by trying that out.
5. Cheat Sheet. Use cheat sheet to create new ideas. What more
would you test than first meets the eye?
6. Feature tours of OSCommerce and OpenCart.Find out what the
two open-source web shops have to offer, point out strong points and
limitations. Be the tester.
7. Isolate a bug on OpenEMR. The first experience with this
software's user creation is that it does not work, new user's login fails.
Can you make it work, and tell the conditions that make it fail in more
detail?
8. Lego Robot Challenge. Come check out the Lego Mindstorm
robots and play with them to find out what they do. We have two
robots, two puzzles and plenty of colors to test with.
9. Reproduce a bug. Someone logged bugs into database already.
Take one, and see if you can reproduce it. If it was missing info that
you found in the exercise, add a helpful comment.
10. Survey to deep coverage. Exploring has a structure. Choose a
system and test it long enough to try different types of testing.
11. Test for Error Messages on XMind. Here's an exerpt from code
of the error messages. Trigger error messages intentionally to test
them. What else would you do for covering concerns on this?
12. Test FreeMind Search and Replace. Here's a relatively new
feature with a specification. Anything to report?
13. Test the Boggle Cubes. A selection of white-and-red cubes to
play Boggle for you to explore. As a product delivered to you in a black
box with instructions, how would you test this? Does the product work?
14. Boosting bug reporting with pictures.Create a video of the
problem you find with http://www.screencast-o-matic.com/ and
compare that to taking screenshots with Greenshot. When would you
go from static pictures to moving images?
15. Burp Suite to security. Work with Burp suite (security testing
tool) to identify problems with openEMR.
16. Exploratory note taking. Try the iTester or Rapid Reporter to
document while you test.
17. First Robotium test from scratch. Create a test project and write
a first test using Robotium for Android WordPress mobile based on
NotePad example.
18. jMeter to performance. Set up your first performance test on one
of our test targets.
19. Leaking memory. Here's an challenge for you on WordPress for
iOS - find a memory leak.
20. SBE to automation on iOS. Write a test to start a new session
with iTester using Frank based on existing examples.
21. Selenium: recorded test / programmed test.Create a selenium
test case with selenium IDE. Then transfer that idea to be more
maintainable as test code in .net or java toolset.
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
KRISTOFFER NORDSTRÖM
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Content
The Test Lab Concept
The EuroSTAR Test Lab Story
What’s In It For Me?
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
What’s In It For Me?
The Test Lab is a place to train and practice your skills
A Test Lab
+
Testing Challenges
http://testing-challenges.org./tiki-index.php
 Testing Dojo
http://www.testingdojo.org
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29
Thanks!
[email protected]
@KrisAnkarberg
Kristoffer Ankarberg | Real Testing? At a Test Conference?!? | Karlskrona Test Gathering | 2014-09-29