The world’s generating mountains of machine data: Web servers, database systems, networking gear and telecommunications systems relentlessly log every activity. And there’s gold in them thar hills. For Web-based companies, mining that gold is as much a necessity as an opportunity.
Edmunds.com has been a purveyor of car pricing information since 1966. In 2006 the company transitioned to Web-only content delivery. The company’s core asset, its pricing data, was readily accessible to anyone—including illicit content scrapers.
Like many information providers, Edmunds.com had to balance the need to protect its data with the need to minimize the legal risks that come with blocking IP addresses. The company’s information security and legal departments were pulling in different directions.