I spoke recently on the topic of \u201cCustomer Focused Test Design\u201d (synopsis: customers don\u2019t really care how much functional testing testers do, or how many bugs they find. A test approach that favors scenarios, -ilities, and customer feedback is better; and a bunch of examples for emphasis\/proof).<\/p>\n
Part of the approach I suggest (and have had some success with), is doing testing of performance, reliability, security, privacy, world readiness, and usability (including accessibility) early<\/u> in the product cycle. Early, as in don\u2019t bother with functional testing, do the ilities instead. The premise (and my experience) is that testing ilities tests the underlying functionality by default, and that programmers are (in general) doing a better job testing for functionality during code development. For more details, I\u2019ll probably have to revive the whole talk \u2013 and that\u2019s not what this post is (intended to be) about.<\/p>\n
There\u2019s one \u2013ility that is critical to the customer perception of quality, but it\u2019s not quite like the others \u2013 supportability. Customers hate problems, but they love<\/em> finding solutions to those problems. Online forums, customer connection programs, twitter, facebook, and other online platforms are quickly becoming support forums for a lot of software. Software companies who engage with customers actively are creating happy customers. <\/p>\n Zappos<\/a> has created a fantastic culture of customer service and have won customers for life (I\u2019m one of them) by actually caring about their customers. <\/p>\n Recently, I moaned on twitter that I couldn\u2019t get my (aisle) seats confirmed for a long flight from Australia to Seattle on a flight booked through Orbitz. Within minutes, @OrbitzCareTeam contacted me on twitter and booked and confirmed my seats. I fly a lot (too much), and I can book my flight with any discount airline\u2013 but Orbitz will get my business. <\/p>\n Last month, I visited an Xbox call center, talked to some of the employees there, and listened in on some calls. I was ecstatic to see that nobody works from a script and there are no quotas or other incentives to push people through the system. I listened to several calls where the support folks took their time helping people solve problems step by step (on occasion, converting customer rage into customer appreciativeness). Most interesting was that none of the calls I listened to had anything to do with the Xbox console. Our support people answered questions about entering codes for other manufacturers games, helped customers reset live id passwords, and a variety of other topics related to \u2013 but not part of the actual console. Every customer hung up happy \u2013 I was blown away.<\/p>\n If you want to be a successful software company, you have to care about customers. In addition to keeping them happy once they have used<\/em> your software or service, you need to respond to their needs and give them what they need. In The Lean Startup<\/a>, Ries drives home the point of iteration as a means to obtain validated learning; with the premise that any work that does not provide value to the customer to be wasteful. In other words, listen and learn \u2013 often.<\/p>\n Sometimes companies get it wrong. I recently had an issue with an application that was overlaying a decoration on my explorer icons. I found the overlays to be distracting and a detriment to my productivity. When I searched online for a workaround or solution (or sympathy), a representative of the company had this to say (bold mine).<\/p>\n Our thinking<\/strong> was that we want the app to be running in the background, all the time. We want<\/strong> to to blend into your experience so you almost never have to interact with [the application] to check the status of things. So we figured<\/strong> icon overlays were a subtle way to do this, while reassuring people that the app was indeed running.<\/p>\n Maybe we can add an option in the future to toggle the overlays, but honestly I wouldn’t hold your breath<\/strong>. There’s plenty of other cool stuff we want<\/strong> to add first \ud83d\ude42<\/p>\n<\/blockquote>\n Note the pronouns in bold. Our thinking\u2026We want\u2026we figured\u2026we want\u2026 \u2013 these are the statements of Engineering Focused Engineering (note the intentional idiocy of that phrase)<\/p>\n To be clear, I like this product. And on my own, I figured out how to disable the overlays. I also don\u2019t know if the statements above reflect the opinions of one person, or a whole software team\u2026<\/p>\n\n