Carl S. Marshall

PIXEE: pictures, interaction and emotional expression

An interactive system, PIXEE, was developed to promote greater emotional expression in image-based social media. Images shared on social media were projected onto a large interactive display at public events. A multimodal interface displayed the sentiment analysis of images and invited viewers to express their emotional responses. Viewers could adjust the emotional classification and thereby change the color and sound associated with a picture, and experiment with emotion-based composition. An interdisciplinary team deployed this system around the world to explore new ways for technology to catalyze emotional connectedness. This paper describes the system, design iterations, and observations about how people used it for self-expression and connection.

Demonstrating PIXEE: pictures, interaction and emotional expression

An interactive system, PIXEE, was developed to promote greater emotional expression in image-based social media. An interdisciplinary team developed this system and has deployed it as a cultural probe around the world to explore ways that technology can foster emotional connectedness. In this system, images that participants share on social media are projected onto a large interactive display. A multimodal interface displays the sentiment analysis of image captions and invites viewers to adjust this classification in order to express their emotional response to the images. Viewers can adjust the emotional classification and thereby change the colors and sound associated with a picture, and compose musical scores by touching a series of images. CHI participants will be able to share their own content and their emotional reaction to other images throughout the conference. If CHI attendees share feedback about presentations through this system, an affective map of the conference may emerge.