What is Mining the Social Web?
Updated
Mining the Social Web is the companion website and blog for the technical book Mining the Social Web, a manual about data mining and social media analysis. The site is aimed at readers who want to turn curiosity about social data into practical insight, and it serves as a home for book-related updates, quick start material, and posts about working with social platform data. If you are looking for the book's supporting content, author notes, or example-driven guidance on mining social web data, this is the place to start.
What the site covers
The site's tagline, "Transforming Curiosity into Insight," reflects its focus: using data mining techniques to extract meaning from social web sources. Based on the site's own headings and posts, its content falls into a few recognizable areas:
- Book updates and author notes — posts documenting the evolution of the book, including the third edition overhaul.
- Quick Start material — an entry point for readers who want to get moving with the book's approach.
- About section — background on the project and the people behind it.
- Blog posts — practical, example-driven write-ups on specific mining tasks.
A closer look at the content
The third edition overhaul
One of the site's notable posts, "Rebooting Mining the Social Web for a Rapidly Changing World," describes how the book was overhauled for its third edition. The post introduces Mikhail Klassen as a new co-author and explains how the project began at PyCon 2016 in Portland, Oregon, where he met an editor from O'Reilly Media. Klassen, who had recently defended a PhD in astrophysics, was brought on to help modernize the book's code to Python 3 and test that everything still ran.
The post also documents a significant challenge: the publishing cycle moves slower than technology. In the wake of the Cambridge Analytica scandal and major data breaches, social media platforms came under heavier scrutiny, APIs changed, and access to data was severely curtailed. Some privileges began requiring approval from platform developers. This context matters for anyone using the book's examples, because a lot of the original code no longer worked as written.
Practical mining examples
The site includes hands-on posts such as "How To Mine Your GMail with Google Takeout and MongoDB" and a "Twitter Data Mining Round Up." These illustrate the site's applied approach: rather than staying abstract, it walks through concrete tasks using real tools and data sources.
Who it is for
The site suits readers who:
- Are working through the Mining the Social Web book and want supporting material.
- Want to understand how social media data mining has changed as platform access has tightened.
- Are looking for example-driven posts on specific mining tasks, such as exporting and querying personal data.
What to keep in mind
Because the site documents a book whose examples were affected by API and access changes, some older code and instructions may no longer work as originally written. The site's own account of the third edition makes clear that platform restrictions reshaped what was possible. Treat the posts as a record of both technique and the shifting constraints around social data access, and check current platform policies before relying on any specific example.