Nic Lupfer

Using Metrics of Curation to Evaluate Information-Based Ideation

Evaluating creativity support environments is challenging. Some approaches address people’s experiences of creativity. The present method measures creativity, across conditions, in the products that people make. This research introduces information-based ideation (IBI), a paradigm for investigating open-ended tasks and activities in which users develop new ideas. IBI tasks span imagining, planning, and reflecting on a weekend, vacation, outfit, makeover, paper, internship, thesis, design, campaign, crisis response, career, or invention. What products do people create through engagement in IBI? Curation of digital media incorporates conceptualization, finding and choosing information objects, annotation, and synthesis. Through engagement in IBI tasks, people create curation products. This article formulates a quantitative methodology for evaluating IBI support tools, building on prior creative cognition research in engineering design to derive a battery of ideation metrics of curation. Elemental ideation metrics evaluate creativity within curated found objects. Holistic ideation metrics evaluate how a curation puts elements together. IBI support environments are characterized by their underlying medium of curation. Curation media include lists, such as listicles, and grids, such as the boards of Pinterest. An in-depth case study investigates information composition, an art-based medium representing a curation as a freeform visual semantic connected whole. We raise two creative cognition challenges for IBI. One challenge is overcoming fixation—for instance, when a person gets stuck in a counterproductive mental set. The other challenge is to bridge information visualization’s synthesis gap, by providing support for connecting findings. To address the challenges, we develop mixed-initiative information composition (MI2C), integrating human curation of information composition with automated agents of information retrieval and visualization. We hypothesize that MI2C generates provocative stimuli that help users overcome fixation to become more creative on IBI tasks. We hypothesize that MI2C’s integration of curation and visualization bridges the synthesis gap to help users become more creative. To investigate these hypotheses, we apply ideation metrics of curation to interpret results from experiments with 44 and 49 participants.

intangibleCanvas: free-air finger painting on a projected canvas

With the advent of new sensing technologies, precision free-air interaction is becoming viable as a contender for the next generation of expressive, embodied interaction modalities. ZeroTouch [5], a novel multi-touch sensor that allows for free-air multi-finger, multi-object sensing, is one example of this next generation of free-air interfaces. We develop its use in a digitally-projected finger painting application, placing the see-through multitouch sensor in direct line-of-sight between an artist and a remote canvas. This allows the artist to reach through the sensor and paint on the intangibleCanvas as if it were directly in front of them. An iPad is employed as a multimodal workspace for color selection. We evaluate the system through an informal walk-up-and-play installation and comparative study, developing implications for interaction design using this type of precision free-air interface.

Promoting reflection and interpretation in education: curating rich bookmarks as information composition

Reflection, interpretation, and curation play key roles in learning, creativity, and problem solving. Reflection means looking back and forward among building blocks constituting a space of ideas, contextualizing with processes including tasks, activities, and ones internal thinking and meditating, and deriving new understandings, known as interpretations. Curation, in the digital age, means searching, gathering, collecting, organizing, designing, reflecting on, and interpreting information. We introduce rich bookmarks, representations of key ideas from documents as navigable links that integrate visual clippings and rich semantic metadata. We support curating rich bookmarks as information composition. In this holistic visual form, curators express relationships among curated elements through implicit visual features, such as spatial position, color, and translucence. We investigated the situated context of a university course, engaging educators in iterative co-design. Rich bookmarks emerged in the process, motivating changes in pedagogy and software. Changes provoked students to collect more novel and varied ideas. They reported that curating rich bookmarks as information composition helped them reflect, transforming prior ideas into new ones. The visual component of rich bookmarks was found to support multiple interpretations; the semantic to support associational exploration of related ideas.

Meta-metadata: a metadata semantics language for collection representation applications

Collecting, organizing, and thinking about diverse information resources is the keystone of meaningful digital information experiences, from research to education to leisure. Metadata semantics are crucial for organizing collections, yet their structural diversity exacerbates problems of obtaining and manipulating them, strewing end users and application developers amidst the shadows of a proverbial tower of Babel. We introduce meta-metadata, a language and software architecture addressing a metadata semantics lifecycle: (1) data structures for representation of metadata in programs; (2) metadata extraction from information resources; (3) semantic actions that connect metadata to collection representation applications; and (4) rules for presentation to users. The language enables power users to author metadata semantics wrappers that generalize template-based information sources. The architecture supports development of independent collection representation applications that reuse wrappers. The initial meta-metadata repository of information source wrappers includes Google, Flickr, Yahoo, IMDb, Wikipedia, and the ACM Portal. Case studies validate the approach.

Patterns of Free-form Curation: Visual Thinking with Web Content

Web curation involves choosing, organizing, and commenting on content. Popular web curation apps-- e.g., Facebook, Twitter, and Pinterest-- provide linear feeds that show people the latest content, but provide little support for articulating relationships among content elements. The new medium of free-form web curation enables multimedia elements to be spontaneously gathered from the web, written about, sketched amidst, manipulated, and visually assembled in a continuous space. Through free-form web curation, content is collected, interpreted, and arranged, creating context. We conducted a field study of 1581 students in 6 courses, spanning diverse fields. We derive patterns of free-form curation through a visual grounded theory analysis of the resulting dataset of 4426 curations. From the observed range of invocations of the patterns in the performance of ideation tasks, we conclude that free-form is valuable as a new medium of web curation in how it supports creative visual thinking.

Beyond Slideware: How a Free-form Presentation Medium Stimulates Free-form Thinking in the Classroom

We investigate how presentation in a free-form medium stimulates free-form thinking and discussion in the classroom. Most classroom presentations utilize slideware (e.g. PowerPoint). Yet, slides add intrusive segregations that obstruct the flow of information. In contrast, in a free-form medium of presentation, content is not separated into rigid slide compartments. Instead, it is visually arranged and transformed in a continuous space. We develop a case study that investigates student experiences authoring, presenting, viewing, and discussing free-form presentations in a graduate seminar class. We analyze interviews, present a sampling of student presentations, and develop findings: free-form presentation stimulates free-form thinking, spontaneous discussion, and emergent ideation.

Metadata type system: integrate presentation, data models and extraction to enable exploratory browsing interfaces

Exploratory browsing involves encountering new information during open-ended tasks. Disorientation and digression are problems that arise, as the user repeatedly loses context while clicking hyperlinks. To maintain context, exploratory browsing interfaces must present multiple web pages at once. Design of exploratory browsing interfaces must address the limits of display and human working memory. Our approach is based on expandable metadata summaries. Prior semantic web exploration tools represent documents as metadata, but often depend on semantic web formats and datasets assembled in advance. They do not support dynamically encountered information from popular web sites. Optimizing presentation of metadata summaries for particular types of documents is important as a further means for reducing the cognitive load of rapidly browsing across many documents. To address these issues, we develop a metadata type system as the basis for building exploratory browsing interfaces that maintain context. The type system leverages constructs from object-oriented programming languages. We integrate data models, extraction rules, and presentation semantics in types to operationalize type specific dynamic metadata extraction and rich presentation. Using the type system, we built the Metadata In-Context Expander (MICE) interface as a proof of concept. A study, in which students engaged in exploring prior work, showed that MICEs metadata summaries help users maintain context during exploratory browsing. \

Evaluating TweetBubble with Ideation Metrics of Exploratory Browsing

We extend the Twitter interface to stimulate exploratory browsing of social media and develop a creative cognition method to establish its efficacy. Exploratory browsing is a creative process in which users seek and traverse diverse and novel information as they investigate a conceptual space. The TweetBubble browser extension extends Twitter to enable expansion of social media associations@usernames and #hashtags-in-context, without overwriting initial content. We build on a prior metadata type system, developing new presentation semantics, which enable an integrated look and feel consistent with Twitter. We show how exploratory browsing constitutes a mini-c creative process. We use prior ideation metrics as a basis for new ideation metrics of exploratory browsing. We conducted a mixed methods crowdsourced study, with data from 54 participants, amidst the 2014 Academy Awards. Quantitative and qualitative findings validate the technique of in-context exploratory browsing interfaces for social media. Their consistency supports the validity of ideation metrics of exploratory browsing as an evaluation methodology for interactive systems designed to promote creative engagement.

The Art.CHI Gallery: An Embodied Iterative Curation Experience

We present an exhibition of the 2015 Art.CHI Gallery as an embodied and iterative curation experience. We develop a method to represent the initial curated collection of interactive art works as a holistic exhibition. We explore how to physically manifest and present the exhibition at the CHI conference. Our exhibition will invite visitors to interact with the gallery as an embodied experience. They will browse the exhibit, as a whole, and view details of individual works. Participants will be encouraged to iteratively curate their own miniature gallery as they peruse. These curations will be made accessible online and shared through social media.

Collaborative Live Media Curation: Shared Context for Participation in Online Learning

In recent years, online educations reach and scale have increased through new platforms for large and small online courses. However, these platforms often rely on impoverished modalities, which provide limited support for participation in social learning experiences. We present Collaborative Live Media Curation (CLMC), a new medium for sharing context and participation in online learning. CLMC involves collaborative, synchronous collection, creation, and assemblage of web media, including images, text, video, and sketch. CLMC integrates live media including streaming video, screenshares, audio, and text chat. We deploy and study LiveMâché, a CLMC technology probe, in four situated online learning contexts. We discovered student and instructor strategies for sharing context and participating including creating curations in advance, sketching to illustrate and gesture, real-time transformations, sharing perspective, and assembling live streams. We develop implications through live experience patterns, which describe how spatial and computing structures support social activities.