Analyzing Millions of GitHub Commits: What Makes Developers Happy, Angry, and Everything in Between?

Ilya Grigorik (Google), Brian Doll (GitHub)
Data Science, Sutton Center / Sutton South (NY Hilton)
Presentation: external link
Average rating: ****.
(4.80, 5 ratings)

Open source developers all over the world contribute to millions of projects every day on GitHub: writing and reviewing code, filing and discussing bug reports, updating documentation and project wikis, and so forth. The data generated from this activity can reveal interesting trends across many industries, including popularity of programming languages over time, defect rates, contribution metrics, and popularity of specific frameworks and libraries.

To help us extract the insights from the public GitHub timeline which generated hundreds of thousands of daily events, we imported the entire dataset into Google BigQuery. This makes data about tens of millions of open source commits and discussions accessible to the world for quick interactive analysis. With that, we can run our analysis:

Who are the most productive developers using GitHub? Which languages are growing in popularity and why? Which language features result in the most angst and developer pain? What makes open source developers happy?

In this session, we will answer the above questions and much more. We will also discuss our experience in using BigQuery, how we modeled the GitHub event data, and the lessons learned in importing and making the data available.

Photo of Ilya Grigorik

Ilya Grigorik

Google

Ilya Grigorik is a web peformance engineer and advocate at Google, an open-source evangelist, an analytics geek, and a proverbial early adopter of all things digital. Prior to focusing on web performance Ilya was the founder and CTO of PostRank, a social analytics company which became the core of social analytics within Google Analytics.

Photo of Brian Doll

Brian Doll

GitHub

Brian is a developer that runs marketing at GitHub, which often involves analyzing a lot of interesting data.

Sponsors

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities, contact Susan Stewart at sstewart@oreilly.com.

Media Partner Opportunities

For information on trade opportunities contact Kathy Yu at mediapartners
@oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

Contact Us

View a complete list of Strata contacts.