Benjamin Mako Hill

LilyPad in the wild: how hardware's long tail is supporting new engineering and design communities

This paper examines the distribution, adoption, and evolution of an open-source toolkit we developed called the LilyPad Arduino. We track the two-year history of the kit and its user community from the time the kit was commercially introduced, in October of 2007, to November of 2009. Using sales data, publicly available project documentation and surveys, we explore the relationship between the LilyPad and its adopters. We investigate the community of developers who has adopted the kit---paying special attention to gender---explore what people are building with it, describe how user feedback impacted the development of the kit and examine how and why people are contributing their own LilyPad-inspired tools back to the community. What emerges is a portrait of a new technology and a new engineering/design community in co-evolution.

The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation

Opt-in surveys are the most widespread method used to study participation in online communities, but produce biased results in the absence of adjustments for non-response. A 2008 survey conducted by the Wikimedia Foundation and United Nations University at Maastricht is the source of a frequently cited statistic that less than 13% of Wikipedia contributors are female. However, the same study suggested that only 39.9% of Wikipedia readers in the US were female – a finding contradicted by a representative survey of American adults by the Pew Research Center conducted less than two months later. Combining these two datasets through an application and extension of a propensity score estimation technique used to model survey non-response bias, we construct revised estimates, contingent on explicit assumptions, for several of the Wikimedia Foundation and United Nations University at Maastricht claims about Wikipedia editors. We estimate that the proportion of female US adult editors was 27.5% higher than the original study reported (22.7%, versus 17.8%), and that the total proportion of female editors was 26.8% higher (16.1%, versus 12.7%).

The Remixing Dilemma The Trade-Off Between Generativity and Originality

In this article we argue that there is a trade-off between generativity and originality in online communities that support open collaboration. We build on foundational theoretical work in peer production to formulate and test a series of hypotheses suggesting that the generativity of creative works is associated with moderate complexity, prominent authors, and cumulativeness. We also formulate and test three hypotheses that these qualities are associated with decreased originality in resulting derivatives. Our analysis uses a rich data set from the Scratch Online Community—a large website where young people openly share and remix animations and video games. We discuss the implications of this trade-off for the design of peer production systems that support amateur creativity.

Remixing as a Pathway to Computational Thinking

Theorists and advocates of “remixing” have suggested that appropriation can act as a pathway for learning. We test this theory quantitatively using data from more than 2.4 million multimedia programming projects shared by more than 1 million users in the Scratch online community. First, we show that users who remix more often have larger repertoires of programming commands even after controlling for the numbers of projects and amount of code shared. Second, we show that exposure to computational thinking concepts through remixing is associated with increased likelihood of using those concepts. Our results support theories that young people learn through remixing, and have important implications for designers of social computing systems.

The cost of collaboration for code and art: evidence from a remixing community

In this paper, we use evidence from a remixing community to evaluate two pieces of common wisdom about collaboration. First, we test the theory that jointly produced works tend to be of higher quality than individually authored products. Second, we test the theory that collaboration improves the quality of functional works like code, but that it works less well for artistic works like images and sounds. We use data from Scratch, a large online community where hundreds of thousands of young users share and remix millions of animations and interactive games. Using peer-ratings as a measure of quality, we estimate a series of fitted regression models and find that collaborative Scratch projects tend to receive ratings that are lower than individually authored works. We also find that code-intensive collaborations are rated higher than media-intensive efforts. We conclude by discussing the limitations and implications of these findings.

Computer supported collective action

Social media has become globally ubiquitous, transforming how people are networked and mobilized. This forum explores research and applications of these new networked publics at individual, organizational, and societal levels. ---Shelly Farnham, Editor

Page protection: another missing dimension of Wikipedia research

Page protection is a feature of wiki software that allows administrators to restrict contributions to particular pages. For example, pages are frequently protected so that they can only be edited by administrators. Page protection affects tens of thousands of pages in English Wikipedia and renders many of Wikipedias most visible pages uneditable by the vast majority of visitors. That said, page protection has attracted very little attention and is rarely taken into account by researchers. This note describes page protection and illustrates why it plays an important role in shaping user behavior on wikis. We also present a new longitudinal dataset of page protection events for English Wikipedia, the software used to produce it, and results from tests that support both the validity of the dataset and the impact of page protection on patterns of editing.

Scratch Community Blocks: Supporting Children as Data Scientists

In this paper, we present Scratch Community Blocks, a new system that enables children to programmatically access, analyze, and visualize data about their participation in Scratch, an online community for learning computer programming. At its core, our approach involves a shift in who analyzes data: from adult data scientists to young learners themselves. We first introduce the goals and design of the system and then demonstrate it by describing example projects that illustrate its functionality. Next, we show through a series of case studies how the system engages children in not only representing data and answering questions with data but also in self-reflection about their own learning and participation.

Consider the Redirect: A Missing Dimension of Wikipedia Research

Redirects are special pages in wikis that silently transport visitors to other pages. Although redirects make up a majority of all article pages in English Wikipedia, they have attracted very little attention and are rarely taken into account by researchers. This note describes redirects and illustrates why they play an important role in shaping activity in Wikipedia. We also present a novel longitudinal dataset of redirects for English Wikipedia and the software used to produce it. Using this dataset, we revisit several important published findings about Wikipedia to show that accounting for redirects can have important effects on research.

Youth Perspectives on Critical Data Literacies

As contemporary youth learn, play, and socialize online, their activities are often being recorded and analyzed. What should young people know about these data collection and analysis efforts? Although critiques of these new forms of data collection and analysis have grown increasingly loud, the voices of users, and particularly youth, have largely been absent. This paper explores the critical perspectives of youth who are programming with public data about their own learning and social interaction in the Scratch online community. Using a bottom-up approach based on ethnographic observation of discussions among these young users, we identify a series of themes in how these youth critique, question, and debate the implications of data analytics. We connect these themes-framed in terms of critical data literacies-to expert critiques and discuss the implications of these findings for education and design.