Amazon's 'schizophrenic' open source selfishness scares off potential talent, say insiders
Moles blame Bezos for paltry code sharing
'There is a particular schizophrenia between retail and technology'
Multiple sources have speculated to us that Amazon's secrecy comes from Jeff Bezos' professional grounding in the financial industry, where he worked in trading systems. This field is notoriously competitive and very, very hush-hush. That may have influenced his thoughts about how open Amazon should operate, as does his role in a market where he competes with retail giants such as Walmart.
But one contact argued that a taciturn approach may not be appropriate for the advanced technology Amazon has developed for its large-scale cloud computing business division, Amazon Web Services.
"In the Amazon case, there is a particular schizophrenia between retail and technology, and the retail culture dominates," explained the source. "Retail frugality is all about secrecy because margins are so small so you can't betray anything – secrecy is a dominant factor in the Amazon culture.
"It's a huge cost to the company."
The cloak-and-dagger attitude has at times been a source of tension in the executive ranks, we're told, and Amazon's chief technology officer Werner Vogels has lobbied strenuously to Bezos for further openness from Amazon.
Vogels' efforts led to a few hard-won successes, such as getting Amazonians slightly more involved in conferences and, notably, Amazon's main contribution to the academic computer-science corpus: the publication of the Dynamo paper [PDF] in 2007. (Aside from Dynamo, Amazon has published a few other academic papers, but far fewer than the hundreds published by rivals such as Google and Microsoft.)
If not for Vogels, the Dynamo paper never would have appeared, one source said. But persuading Vogels to air some of Amazon's bespoke laundry in public was tough, they said. "It was a hard argument to make," the source said.
Since then, Amazon has not published another paper describing an internal production system, though it has certainly made great technological strides. This compares with rivals such as Google and Microsoft, which regularly lift the curtain on the titanic systems built to keep their information empires humming.
"It's extraordinarily difficult to get anything out of [Amazon]," said another former employee.
Of the nine people listed as authors on the Dynamo paper, four have since gone on to other companies ranging from their own ventures to Google and other big names.
Of the sources with whom we spoke, many indicated that Amazon's lack of participation was a key reason for why people left the company – or never joined at all. This is why Amazon's strategy of maintaining secrecy may derail the e-retailer's future if it struggles to hire the best talent.
"Amazon's approach to open source was regarded by other people as ethically questionable," said one source.
"I think if you want to go on and have a research career, it is sort of a black hole," noted a prominent industry observer.
"The sense that I always had was we were heavy consumers of open source but not really much of a flywheel for generating and pushing change back out," said another former Amazonian.
"In many cases in the big companies and all the small startups, your Github profile is your resume," explained another former Amazonian. "When I look at developers that's what I'm looking for, [but] they go to Amazon and that resume stops ... It absolutely affects the quality of their hires."
"You had no portfolio you could share with the world," said another insider on life after working at Amazon. "The argument this was necessary to attract talent and to retain talent completely fell on deaf ears."
Though some sources with whom we spoke argued that Amazon has, in a sense, an ethical duty to the technology industry to share its learnings with the wider community, this argument offers little to shareholders. However, the most persuasive argument for investors is that Amazon will ultimately lose marketshare to competitors that can attract and build technology teams that are better skilled. All the anecdotal evidence we have gathered indicates that unless something changes, Amazon risks alienating its workers from the rest of the technical community.
Though we have no doubt the company will continue to be able to hire smart, capable people, we imagine that if it continues to be so closed, it may have trouble attracting the top tech talent – and in an age in which companies depend upon arcane systems conjured up by idiosyncratic people, this may have repercussions. ®
* Due to Amazon's stringent policies, we will not identify any of sources lest they face repercussions from the eldritch horrors of the company's HR department.
Sponsored: RAID: End of an era?