When in a rush, stop and look around

This is a little recap of what happened during the summer and early fall.

I have had a quite summer. In addition my wife getting a great job from an esteemed Finnish restaurant and the scheduling followed by that, I have been busy trying to build my career within the company. The career building alone was enough to suck the juices out of me (deputing my boss, making connections, etc.) I found my previously hibernating hobby, miniature painting and modeling.

All that compared to my lack of self discipline to edit my workshop video (which became a hurdle I came to dread) resulted in a complete inability to update my blog or tweet about stuff happening around me, all the while feeling guilty about not getting stuff done.

However, all my networking, deputing and the effort spent within the company resulted in a promotion. The “deal” is finalized during the next month which will lead into senior position in F-secure in addition to receiving the responsibility of all platform maintenance handling in Finland (excluding some separate items). Being able to breathe a while and get to start rebuilding my focus, I decided to write this update post to get some sizzle going on in the blog.

I’m also glad that my wife (Love you, baby!) has been able to handle the restaurant manager job with such awesomeness that I almost envy her passion towards the domain. With all scheduling problems and prioritizing we were able to pull it together and now it pays itself back. A week’s beach holiday is ahead of us and we are to discuss about the move to the Helsinki area, which will drastically decrease my commute time (which is 5 hrs/day every day).

I was so empowered by Santhosh Tuppad’s blog post about highlights of the year I decided to write some of my own highlights from the past 12 months. These are all as in what I remember and may be incorrect, but this is how I view the world 12 months ago:

• September 2011: I came to contact with F-secure’s awesome people when I applied for an exploratory testing role model position. I did not get the position, however, but they contacted me with a little different job description. They offered me a position as a second maintenance manager and a quality engineer.
• October 2011: I got a role as a testing expert in Itella Corporation’s quality board (I don’t know exactly what the group was called, but we talked about testing and outsourcing) and came to contact with some very talented people. Although with somewhat different views I was able to suck in few good tips as a test manager on the way.
• November 2011: I started working at F-secure. Also I got my first contact with teaching testing to a larger group. That sparked a flame for more workshops.
• December 2011: The beautiful Maldives! A ten-day honeymoon at a 5-star hotel with my dear wife recharged my batteries for the busy year 2012.
• January 2012: I got to try my wings in a feature team at F-secure testing client software. Great times with great people!
• February 2012: I wrote the first draft of the Heuristics Testing Qualification which was evolved into a monster. By the summer I had talked with James Bach about the concept and I decided to rewrite the basic structure of the qualification. That is still on the drawing board but the first draft pushed a stone down the hill and it has began to “land-slidify”.
• March 2012: I have no clue what happened on March, but maybe that’s a good thing. The highlight of March is that nothing worth mentioning happened.
• April 2012: I had a workshop at my previous company, Logia Software Oy, where I… learned a lot about how to hold a workshop and how to arrange my presentation. Hard knock life, if that’s the correct expression, but ever so necessary.
• May 2012: Turku Agile Days 2012! Testing with the stars! I met Anssi Lehtelä, Sergey Moshnikov, Lisa Crispin, Elisabeth Hendrickson, and lot of friends from Scandinavia and the Globe. I’m looking forward to having another go at Testing with the Stars as soon as possible (I might even want to judge one, if possible).
• June 2012: The Nordic Testing Days 2012! What more can be said? Sami Söderblom as my trusted wing man (he'll hate me for saying that), all the great Estonian testers, the beautiful city of Tallinn. Ten out of ten. Also I got the chairmanship (actually it’s called Community facilitator) of the Finnish Association of Software Testing. In addition to all that, I met Rex Black and had some good conversations with him.
• July 2012: Deputing my boss, Harri, as a maintenance manager. Almost the toughest four weeks in my life. That really helped me to understand the systems we have in more depth and the people behind the beating heart of F-secure.
• August 2012: “Laatu ja testaus”, a Finnish testing magazine was published and I was able to sneak in a column of my own “Pekka kirjoittaa lehteen” which is “”Pekka writes into a magazine” (original, huh?)
• September 2012: There is a number of weeks left until I go into to the to-be team as a maintenance manager and also I’m looking forward to getting my presentation for the October’s Tampere Goes Agile (there’s a twist involved, right Anssi?) and my University guest lecture about how REAL testing is done.

I do realize that almost all of these are career or work related highlights and that sums my year pretty much up. I have worked like crazy and during the summer I was so tired I couldn’t finish my reading assignment I had agreed with Aleksis Tulonen, the editing of my workshop video, and many other things left to the table by the hectic spring and the early summer. The two months I gathered strength have proved invaluable to me and I can start pushing forward with new spirit. I was in a rush to get somewhere, but I was wise enough to stop and took a breather (thanks to Pirita for saying that all over again to me during the summer).

I want to thank Santhosh for making such an inspiring blog post. That was the push I needed to get back on the horse and start blogging and tweeting with such gusto like none before.

New winds blow! The horizon is the goal! … I’m going sailing!! (I mean "I'll do more blogging”)

The magic medallion of testing - summary of a keynote by Rex Black

This is a summary about Rex Black’s keynote about Testing and Quality management at Nordic Testing Days 2012. This was the first keynote on the second day. People were still tired from the evening activities and some even skipped the keynote altogether. I was keen to see Rex’s track as I had some… opinions about ISTQB and the certification system as a whole. So, to be there and be able to challenge him was an opportunity I didn’t want to miss.

On Monday we had "argued" with Rex about metrics and coverage. Rex commented Sami Söderbloms statement about not measuring coverage by giving an example. The discussion went something like this: “With all things being equal, the first tester returns his test report with 90% coverage and another with 15% coverage. Which one would you trust more?” Rex commented. I raised my hand (the inner voice screaming "Me, me, me! Let me answer!". Sami then said that I could answer the question. I tried to question the true coverage by asking about what has been found. Rex replied by pleading to the all-things-being-equal statement. All things that were found were supposed to be equal (so as important bugs, issues, etc.) “But all things are never equal in software testing”, I said. Later I realized that if all things were equal, how can there be a difference in the coverage?

If we have all things equal, isn’t the coverage supposed to be equal too? If two clone testers are put to test a product in exactly the same way, don’t they both produce the same amount of coverage in any way you measure? Change anything and all things are not equal. So if in an all-things-being-equal-situation we have difference in coverage, our model to measure testing might be faulty, the person interpreting the results may be biased, etc. So how can one make an example from a situation that is faulty by default?

The keynote however began with Rex warning about using the c-word (coverage) and the m-word (metrics). I immediately knew this wasn’t going to be pretty. ;)

Rex gave a few cases where a manager was oblivious about the need for skilled testers. One manager had supposedly said something like this: “The requirements of a tester: heartbeat, respiration.” That struck home right then. I knew these managers and product owners exist! I had been in a project where the solution to testing was “ask people around if they have the time”. I then asked around and gathered as good a bunch of people I could find… and I tried to train them to be adequate testers. Some became good testers, some didn’t, but I had a team.

Feels like the requirements for a tester in fact are the aforementioned heartbeat and respiration. In some cases, though, also a certification might be squeezed. If we find a tester with a certification, one has to be a good tester! Right? Rex mentioned in the talk (which I already knew from previous experience with the ISTQB) that people who certify themselves with the foundation level certification do not need any skills from testing before the certification. It is “an entry-level certification”, Rex says. So how come people with no skills are certified as testing professionals? This leads to a situation where unskilled, untalented testers that look better to managers than people with REAL skills and attitude towards testing. I that what it is suppose to be doing?

The certification thing got me so winded up that I almost missed the rest of the keynote while trying to douse my building rage. (Just kidding! ;) ) Rex had some good thoughts about how to veer the Agile testing more towards intelligent testing – away from “Unit testing + Acceptance testing = Proper testing” an more towards testing throughout the life cycle. Automated testing is there only to support manual testing*. Usually Agile testing is a Waterfall within the Agile cycle where testing is done at the end of the cycle (if we have the time). Testing earlier, reviewing the deliverables in time and early enough, challenging designs, etc. – not just automating unit tests.

Rex also talked about the cost of bugs, but there was no ground breaking new information about that. I have read that from the ISTQB syllabus a while ago. And I still believe that counting bugs and measuring them against each other will lead into biased view that “all bugs are equal”. James Bach said it well once that “bugs should be thought as unicorns” How many unicorns fit into a cubicle? Two?) How many bugs are in a product? I know this is generalization from Rex’s part but I think it dangerous to make such claims as (like I mentioned earlier about the decision-making skills of a manager**) people WILL make the tools out of the metrics to compare PEOPLE against each other. "I found 4 bugs and he only found 3. I'm better, right?"

Rex also talked about the quality management. He mentioned that good testing doesn’t make good quality in its own. I agree. We need to be able to start making good quality from the top, starting with directors. We also need to be able to improve the processes, tools, skills and communication to make better quality. We can do it all the time while we work by challenging bad behavior and encouraging good behavior.

Anyway, I feel that the foundation level certification is not currently building the community towards good testing. It has become a magic medallion that is bought from the wandering gipsy saleswoman. And when the kings and queens see the medallion they say “This must be a skillful knight as he has the Badge of Knighthood”. And yes, the medallion is bought, not earned. The training courses for the foundation level solely aim to give answers to the exam questions. They do not encourage people to learn, but to memorize (the worst thing is that they might say that one doesn’t need this information in practice). Rex said that when his consultancy company holds these courses they focus on practical use of the things trained. I wish I could once attend one of his company’s courses to see how it is done.*** The whole certification issue might need a blogpost of it's own, but it will have to wait. Some people have already covered that for me.****

You might get a message that I didn’t like Rex or his keynote. I did in fact, and I encourage all of you to read Rex’s blog and the books he has written. I don’t say I agree with all he writes but they give you a lot to think about. Rex as a person is (to me) "a happy giant"*****. What I liked most about him is that he really listens to what you have to say. We had inspiring conversation with Rex after the keynote although I challenged him about the ISTQB. I hope to hear him talk again at some other event. And I was bummed that he couldn't join my workshop... :(


*) And to build confidence, some say. But, like Michael Bolton said in the Rapid Software Testing course: “Were not in the confidence building industry – we’re in the false confidence demolition industry!”
**) Says a guy who spent two years as a test manager and is currently a maintenance manager deputy.
***) Do you dare to invite me to a course, Rex? ;)
****) Jari Laakso's post http://jarilaakso.blogspot.fi/2012/02/test-is-dead-vs-istqb-kills-people.html
*****) He's like 7 feet tall.