Dedupe, Merge, and Purge: the Art of Normalization

Tyler Bell (Factual), Leo Polovets (Factual)
Data
Location: Sutton South
Average rating: ****.
(4.00, 1 rating)

Big Noise always accompanies Big Data, especially when extracting entities from the tangle of duplicate, partial, fragmented and heterogeneous information we call the Internet. The ~17m physical businesses in the US, for example, are found on over 1 billion webpages and endpoints across 5 million domains and applications. Organizing such a disparate collection of pages into a canonical set of things requires a combination of distributed data processing and human-based domain knowledge. This presentation stresses the importance of entity resolution within a business context and provides real-world examples and pragmatic insight into the process of canonicalization.

Photo of Tyler Bell

Tyler Bell

Factual

Tyler Bell is the Director of Product for Factual, an LA-based startup that is, amongst other things, creating a global coverage of the world’s places and local businesses. He previously taught archaeology at the University of Oxford and, more recently and topically, was the Product Lead for Yahoo’s Geo Technologies Group. He writes about semantic- and geo-technologies for O’Reilly Radar at http://radar.oreilly.com/tylerb/

Photo of Leo Polovets

Leo Polovets

Factual

Leo is a software engineer at Factual where he works on data cleaning tools and entity resolution. Prior to Factual, Leo was a software engineer at Google and an early engineer at LinkedIn.

Sponsors

  • Aster Data
  • EMC Greenplum
  • GE
  • Lexis Nexis
  • MarkLogic
  • Tableau Software
  • Cloudera
  • DataStax
  • Informatica
  • DataSift
  • Splunk
  • Amazon Web Services
  • Datameer
  • Impetus
  • Karmasphere
  • MapR Technologies
  • Pervasive
  • Platform Computing
  • Revolution Analytics
  • Sybase
  • Xeround
  • Media-Science
  • Platfora

Sponsorship Opportunities

For information on sponsorship opportunities at the conference, contact Susan Stewart at sstewart@oreilly.com

Press & Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

Contact Us

View a complete list of Strata Contacts