A while back (no link cause I’m lazy), I mentioned that one thing (among many) missing from How We Test SW at MS was a bibliography of testing books. While we didn’t refer directly to any books when writing the book, the influence of several testing books is definitely there, and worth noting for those who want to study where the craft has come from (which is one way to better understand where it’s going). This post will now serve as the official bibliography of the 2008 edition of How We Test Software at Microsoft. That should get at least one nagger off my back.
But First…
My bookshelf is filled with four different types of books (technically, three – one type is a subset of another.
- Business-ish books. I have (and read) a lot of books on leadership, innovation, etc.. I think these are important for all leaders and those who want to influence (definitely not just managers). These books contain the most read and most loved books in my collection – but none of them are included in this list.
- Books on thinking. I also read a lot of books about thinking and motivation. Examples include Michalko’s Cracking Creativity and Thinkertoys, Kahneman’s Thinking Fast and Slow, Pink’s Drive, and A Whole New Mind, Weinberg’s General Systems Thinking, and Chabris’s The Invisible Gorilla . I think books like these are a great resource for anyone who does knowledge work. A good way to push my buttons (as many of you know) is to take a nugget from a book like these (the gorilla is, of course, my favorite), and announce to the world, “OMG!!! THIS IZ JUSST LIK TESTING!!!!!!!!” These books aren’t in this blog-iography either.
- Software books. The final category is books about software engineering. Note that there are examples of software books that overlap into the above categories.
Please don’t ask where book “Foo” fits into the above categories. The category list above is arbitrary and I just made it up. I may change it later (or by the time I post this).
Category #3 above also includes books on software testing – and after an introduction that is now likely longer than I expect the list of testing books and notes to be, let’s get started. Below is a list of the software testing books that I believe have contributed in some way to my test education (and hence, my own teaching and the writing of HWTSAM), as well as directly and indirectly to many of my peers. In no particular order (other than the order you can find them on the shelf in my office from right to left):
- Software Testing Techniques by Boris Beizer. This book has a comprehensive overview of a whole lot of testing techniques. Some of them are good, some don’t apply, and some are complete bullshit. I tell a story about my journey with software testing books where I say, “When I read my first book on software testing, I thought I learned it all. After reading a second book on testing, I was confused. After reading a third testing book, I began to form my own opinions. For me, I don’t think it’s fair to determine where formal models apply and don’t apply until I really understood them – and this book gave me that background.
- Software Testing: A Craftsman’s Approach, by Paul Jorgensen. This is another book in the “comprehensive” category, and deals entirely with software testing techniques. Again, it’s an exercise for the reader to figure out the best ways and contexts to apply the techniques (and to filter out the bullshit), but as far as basics of testing goes, it’s one of my favorites. I know that Bj was influenced heavily by Jorgensen’s work, and I think it shows in his chapters on functional techniques.
- A Practitioner’s Guide to Software Test Design, by Lee Copeland. I hate to say this, because Lee occasionally reads this blog, but this is my absolute favorite book on the basics of Test Design. For me, it was so much easier to read than the Jorgensen and Beizer books (and the even Meyers book I’m about to mention), and I think it’s much easier for the reader to take the information in the book and apply it to their own work. I don’t recommend reading just one book on test design (see my comments on the Beizer book), but this is one I think is worth having on your shelf.
- The Art of Software Testing by Glenford Myers. This one is sort of the classic of software testing. It too, focuses on functional techniques (and introduces the classic triangle testing problem). Note that this book Ii s generally way overpriced ($130 on Amazon right now)– look for a used copy if you want to own it.
- Testing Object-Oriented Systems, by Bob Binder. I probably mentioned this book in the chapter on model-based testing. This is the book where I first studied MBT, and also the book that got me thinking deeply about test patterns and patterns in general (I was inspired by this book to finally read the GOF book, as well as Alexander). Note that this book can double as a weapon. It’s just under a zillion pages long, so I recommend reading it in chunks rather than in a single three-week sitting.
- Software Testing Techniques by Loveland and Miller. In a way, this book could be called How We Test Software at IBM – or, perhaps, Things you can learn from Mainframe Testers. This book came out just a few years before we began writing HWTSAM, and probably subconsciously influenced my decision to agree to think about possibly writing a book about testing at Microsoft. There are a lot of lessons to be learned from this book, and although it’s applicability to my world of testing has waned quite a bit in the last decade, there are definitely some nuggets here for anyone.
- This is the placeholder for something obvious I’ve missed. I’ve read dozens of other books on software testing, and unless someone has borrowed something significant without asking, I have to say that those are the most likely books that influenced my world view of testing – and likely what we drew from (at least indirectly) when writing HWTSAM.
Well… those six books and a combined half a century of practical experience from the authors, and a millennia of experience from the combined contributors.
And, this book just came out last month on Amazon:
http://www.amazon.com/MetaAutomation-Accelerating-Automation-Communication-Actionable/dp/0986270407
I know you have one, Alan, because I sent you a signed copy 🙂
This is very new, innovative and powerful, but not necessarily easy to learn. IMO it will be very influential for the future of automation.
On the manual types of testing, well, it helps that too.
Well…without a time machine, I can’t go back and read that book before I wrote (write?) hwtsam, so yours will have to wait for another list.
Yes indeed 🙂
Wait… you don’t have a time machine yet? Oh you do, you just don’t know about it at this time
Hi Alan, thank you that you hold promise. By the way, you promised to write this list in comments for this your post https://angryweasel.com/blog/hwtsam-six-years-later/
I am not sure why you wouldn’t include Cem Kaner’s books.
I respect Cem and the work he’s done for testing and software. I’m in the minority, but I don’t like his books. I sometimes re-read TCS to see if it will resonate or to see if I missed something, but it just doesn’t click with me, and I find little that influences my thinking about testing.
In my MetaAutomation book, I slam a point in Myer’s book pretty hard (for a very good reason). IMO it’s too far out of date to be very useful today for most projects.
Hi Alan,
I got Robert V’s book (TOOS) around 3 months back to understand, learn and implement Test Design patterns. I am a tester primarily works on Functional testing side and do not get access to code level as it is already developed Unit tested by Dev team. What kind of view I need to have in software developed by others? Is this book only helpful when I do White Box testing? What is the best way that you can suggest to me to get most from this book, at least, as far as Test Design patterns are concerned? I need some direction so that I can start with this book in a reasonable manner to Learn and Implement the Test Design Patterns? Please guide…
Thanks
-Sandeep
I discussed Test Patterns in hwtsam (entirely influenced by Binder), and followed up with a blog post for mspress here – http://blogs.msdn.com/b/microsoft_press/archive/2009/08/03/patterns-for-testing.aspx
Hopefully this will help get you started.
Hey Alan. Love your content. I wish you had an email list for me to follow your blog.
Hit reply. When you’re typing your reply, look down about 2 inches, and you should see two check boxes.
_ Notify me of new comments via email
_ Notify me of new posts via email
Selecting the second is /supposed/ to send you an email when I create new posts