IT design: You're not data, you're a human being
Remember folks, dissatisfaction is viral
Metrics and you "Metrics" is rapidly becoming something of a cult among IT vendors. Many are betting the future of their companies on data gathering and foster a culture that treats user behaviour-monitoring like a religion. I've never fully believed in this practice, but it is hard to deny its allure.
People are fickle and hard to predict; the idea that we can reduce the complexity of design choices to simple maths is tantalising.
The key to metrics-focused design is to build as many tracking systems into everything you make as possible, collect the data and analyse it.
You focus your development on meeting the needs of the majority of users as demonstrated by the data to hand - enhancing these scenarios and targeting everything from advertising and website design to hardware at these usage scenarios. I've some problems with this.
People hold grudges
In the 1990s I fell in love with Minidisc; it seemed like a great solution to the size (and write-once issues) of CDs while giving me better quality audio than cassette tape. Yet I never could get Minidisc drives for my computers and the cost of the media didn't come down to a sane level until long after I had given up and moved to MP3 players.
Sony computers were always more expensive than the competition and never quite lived up the durability and cutting-edge awesomeness that their brand had burned into my mind in the 1980s. Sony is one of the more prominent copyright maximalists of the RIAA/MPAA. Little things like this always left me with a niggly feeling like they were less "on my side" than most corporations.
The net result of these actions was a sub-conscious – but very real –hatred of the company.
I try very hard to be objective about everything. I know many of you will laugh – your own prejudices tell you that every time I disagree with you it is my personal biases shining though – but the statement is true.
I'm entirely conscious of the fact that no person can be completely objective, yet I hold objectivity as important on a personal and professional level. If a customer asks me to order a computer for them I put marked effort into suppressing any biases I am conscious of and make the best choice for the client, even if it goes against my own preferences.
Where this plays into Sony is that my disquiet with the company is so absolute, my bias against them so complete, that when making these sorts of calculations for customers Sony never even enters consideration.
It is not that I consciously discard them from consideration, it is that when I think of technology vendors my brain simply refuses to supply Sony for conscious consideration at all. The fact that my brain does this at all shows me the power that alienation can have on the purchasing decisions of individuals.
The amplification of ill will
People rarely talk about the awesome things that they encounter every day, (though social media is changing that.). "Works as advertised" makes for dull journalism and worse gossip.
In general, negative word-of-mouth feedback is more potent than positive feedback. In some cases positive messages can trump negative ones; you can successfully market your way out of PR disasters with some product types.
Sadly for IT vendors the rationale behind IT purchase decisions is often preventative (rather than consumptive) in nature. The evidence available suggests that in these situations dissatisfaction is viral.
Social media changes the rules through amplification. My home network might only have 80 or so devices with IP addresses. The combined active addresses that I am responsible for across the networks I manage professional are probably closer to 15,000. If you take my "social" footprint into account then my personal negativity probably influences the purchasing decisions of 500,000 devices a year.
What needs to be considered here is that I'm positively small potatoes in the IT world. I don't buy on the scale of some admins, nor do I have the "thinkfluencer" reach of the top bloggers. There are individuals out there that influence the purchase of tens or even hundreds of millions of devices every single year. As more and more people are "always on", the brand damage that can be wrought by one tweet is humbling.
Choice and interpretation matter
None of the above is to say that metrics are inherently bad: they aren't. As with any religion it is the fundamentalists – those who rigidly apply the religion's dogma regardless of circumstance – who are the problem.
Let's say that I have two workflows that could potentially be changed. One of these workflows is something I have done every single day of my life for 15 years. The steps take fractions of a second and are burned into my muscle memory such that the implementation of this workflow is entirely autonomic.
If you change this workflow in any way I am going to get very, very upset. I've learned this already and it doesn't take me a lot of time to execute. Changing this workflow will cause me to unlearn something then relearn it; convincing me this is a good idea and in any way in my personal best interests will take quite a lot of doing.
The other workflow is something I do twice a year. It is done so infrequently that I have to re-learn how to do it each time. I will cheer you on if you can make this task more intuitive or make it take less time.
In the world of metrics the differentiation between tasks is rarely so clear. Most things fall into a fuzzy middle for people; figuring out what you can safely change and what you can't is more art than science. It involves interpreting that data you've collected and applying it to human behaviour, but people won't all react to the same changes in the same way.
Edge cases have fought long and hard for consideration in interface design; battles that are still ongoing today.
How many website designers put any effort whatsoever into making their site navigable by the blind? How many of us design anything at all to take into consideration color-blindness, dyslexia or any of dozens of other common sensory or neurological differences?
I accept that as an SME sysadmin who designs systems and networks for companies that need enterprise-class computing but have close to household budgets I am probably an edge case in nearly every conceivable circumstance. I accept this with the same resignation as a left-handed person looking to buy a decent mouse. Despite this, I still get angry when a usage case that I had previously relied upon is nerfed or eliminated entirely.
If I – someone who has understood the pragmatic rationale for the decisions made for some years now – still get angry when choice is removed from me then it is entirely possible that others may experience is similar reaction. Having done careful and thorough research of individual reactions on the internet I am 95 per cent certain (19 times out of 20) that getting a bit miffed at such events is a shared experience.
While technology titans probably shouldn't care one whit about alienating Trevor Pott, lord and master of absolutely bloody nothing, everybody is an edge case at some point. It stands to reason that if you treat edge cases poorly you will eventually alienate your entire customer base.
To measure is ... to mismanage?
On the outside looking in
For a practical example for a recent design meme that has affected me directly let's look to the replacement of pictographic information representation with textual search.
My particular problem is that I do not think in words. The term for this is "non-linguistic cognition" and there are still scientists out there who argue that it is impossible. (For a fun time argue higher-order conceptualisation with a linguistic relativist.)
I think in what I can only describe as "objects." Each object has multiple properties; dominant among them is a visual representation, but names, smells, sounds and other data is associated with each object-concept. I have a hard time remembering names and phone numbers but I can tell you how many wrinkles were on in your collar the first time we met.
The result is that I think it is in a series of interrelated object-concepts that actually take longer to assign names and words to than it does to iterate the next thought, so I almost never bother with linguistic identification.
Traditional WIMP GUIs are perfect for me. I can remember things through a variety of means; icon shape/colour/content, pattern matching (it's in the top left, of "click here and then here and then here".)
If I can't easily recall what I am looking for then there are hierarchical menus to search though that closely mirror the object-linking pattern my brain uses to categorise object-concepts.
Searches are terrible for me; I don't remember the name of applications and my brain crates application categories based on the name of the first application I used. I don't think "word processors" I think "that newfangled wordperfect." I imagine this is similar to the genericisation of brand names.
I use computers mostly because they remember this stuff for me. Lists, menus, directories and other nested hierarchies allow me to – for lack of a better term – cope with my "disability". (I argue the use of the term "disability" because it wasn't a disability until we started to need to remember the names for everything.)
"Metrics" say that not enough people use computers the way I do for it to be commercially viable to keep putting development efforts into us. The middle of the bell curve has spoken and just like that I now have a "disability" that has a meaningful impact of the length of time it takes to accomplish tasks in my everyday life.
Looking to the past to profit from the future
I'm not looking to argue for the elimination of metrics in design. That would be silly; every scrap of information helps. I do, however, think that talking to people and understanding the complexities of their motivations still has to play a role.
We need to talk to our best clients to make sure we meet their needs but we also need to engage with our most brutal critics and see what it takes to mend fences. Something as simple as making people feel listened to by giving people an outlet to vent can make people more likely to buy your stuff, even after you've wronged them.
Most critical of all is that we need to be capable of admitting fault and failure. You will get a hell of a lot more mileage out of "mea culpa" than you will out of spending millions on trying to convince the world that you never made a mistake, followed by some half-hearted reversal that pleases nobody.
Irrational as it may be, we seek humanity from corporations; people are more likely to purchase from companies we view as socially responsible.
Give me data and I will perceive it through the lens of my own experience and prejudices, no matter how hard I try to be objective. In running my own life this doesn't matter all that much. When writing articles it does; here I seek out others to sanity check my work before publishing because my words will be read by thousands – if not millions – of people.
What then is the burden to be carried by companies shipping products that affect the lives of billions of us? To what standards of design, care, consideration and compassion do we hold them? What are the standards to which they hold themselves? Are we comfortable with being held hostage to a religion that only values "the majority"? Thoughts in the comments, please. ®