Be Careful What You Choose to Measure – Lean Startup Co.

On Thursday July 26, 2018, Facebook set a dubious record: The value of their shares plunged 19% erasing $119 billion in market value – the biggest single-day loss in market cap ever for any public company. Mark Zuckerberg’s personal loss was $16 billion. Almost at the same time, Amazon posted a quarterly profit of $2.5 billion pushing its stock up over 4% as their market valuation inched tantalizingly close to $1 trillion. Jeff Bezos is by far the richest man in the world with a personal net worth of over $140 billion.

In my non-expert opinion, I feel the market may have overreacted to Facebook’s recent issues. That being said, the contrast in Amazon and Facebook’s fortunes did bring to mind how optimizing internal metrics that aren’t about customer value can eventually bite you.

“…optimizing internal metrics that aren’t about customer value can eventually bite you.” -hughmolotsi Click To Tweet

Although financial metrics (revenue and profit growth) are the ultimate scorecard for publicly traded companies, investors and employees often look at other metrics to gauge performance. For one, many companies have attained stratospheric valuations without managing to make money. In fact Amazon barely managed a handful of profitable quarters in its first two decades of existence. Second, financial metrics tend to be after-the-fact and are generally not suitable for managing an organization in real time – it’s like trying to navigate a car forward by only looking at the rearview mirror.

Facebook’s altruistic-sounding mission statement is “To give people the power to build community and bring the world closer together.” But when you consider the nature of their ad-driven economic engine, and their internal metrics, you get a picture how Facebook’s progress may run cross-purpose to their users’ interests.

“How does it make you feel to know that a firm is trying to optimize your addiction to their product?” [email protected] Click To Tweet

Also, is it really in users’ best interest that their Facebook data is being used to help advertisers target them? Does getting really good at mining customer data for profit cultivate a culture where data can be inadvertently sold to bad actors like Cambridge Analytica?

And is Facebook really bringing the world closer together when optimizing news feeds for average time spent on the platform may also mean only showing people information they are likely to agree with and keeping users in their respective bubbles?

Now let’s take a look at Amazon’s internal metrics. Amazon’s approach is rooted in the philosophy that when customers win, Amazon as a company wins. Their vision statement is: “To be earth’s most customer-centric company, where customers can find and discover anything they might want to buy online.” To that end, they’ve defined their top three metrics: offer wider selection, lower prices and fast, reliable delivery.

Through “wider selection,” Amazon strives to offer customers the ability to purchase just about anything they can imagine on their platform. Amazon’s first slogan was they were “the Earth’s Biggest Bookstore.” Fast-forward a few decades and Amazon is the world’s largest retailer taking on every product and service category in its reach.

Through “fast, reliable delivery,” Amazon strives to deliver purchased products to customers as quickly as possible. Amazon has gone to great lengths to improve this metric through a successive series of innovations including: making fulfillment centers more efficient, setting up warehouses inside large metropolitan areas, and offering same-day shipping in places like London. I’m not sure how seriously we should take Amazon’s purported interest in delivery drones, but I wouldn’t completely write it off either.

In tracking metrics where customers win, Amazon doesn’t have Facebook’s problem where progress gained (as measured by internal metrics) also causes company behavior that works against customers’ interests.

As we come up with internal metrics for our own ventures, we can take this lesson from Amazon and Facebook: Optimizing for metrics that don’t align with your users’ interests may eventually put you in predicament where your practices are at odds with your users and your mission. Be careful what you choose to measure. You might just become really good at it.

“Be careful what you choose to measure. You might just become really good at it.” [email protected] Click To Tweet

Thank you to Hugh Molotsi for contributing this piece. In their forthcoming book Jeff Zias and Hugh are writing about how companies can drive growth by empowering employees to work on their own ideas.