Jelle van Dijk

Can there be such a thing as embodied embedded cognitive neuroscience

Contemporary cognitive neuroscience, for the most part, aims to figure out how cognitive processes are realized in the brain. This research goal betrays the fields commitment to the philosophical position that cognizing is something that the brain does. Since the 1990s, philosophers and cognitive scientists have started to question this position, arguing that the brain constitutes only one of several contributing factors to cognition, the other factors being the body and the world. This latter position we refer to as embodied embedded cognition (EEC). Although cognitive neurosciences research practice and EEC do not seem to fit well together at present, it is pertinent to ask if a variant of cognitive neuroscience can be developed that sets itself research goals that are more congenial to the EEC view. In this paper we investigate this possibility. We put forth a new guiding metaphor of the role of the brain in cognitive behavior to replace the current cognitivist metaphor of the brain as an information-processing device. We also identify a research agenda that naturally arises from our metaphor. In this way we hope to provide an impetus for cognitive neuroscientists to pursue an EEC-inspired research program.

A Lazy Brain? Embodied Embedded Cognition and Cognitive Neuroscience

From the article: Abstract Over the last decades, philosophers and cognitive scientists have argued that the brain constitutes only one of several contributing factors to cognition, the other factors being the body and the world. This position we refer to as Embodied Embedded Cognition (EEC). The main purpose of this paper is to consider what EEC implies for the task interpretation of the control system. We argue that the traditional view of the control system as involved in planning and decision making based on beliefs about the world runs into the problem of computational intractability. EEC views the control system as relying heavily on the naturally evolved fit between organism and environment. A ‘lazy’ control structure could be ‘ignorantly successful’ in a ‘user friendly’ world, by facilitating the transitory creation of a flexible and integrated set of behavioral layers that are constitutive of ongoing behavior. We close by discussing the types of questions this could imply for empirical research in cognitive neuroscience and robotics.

Seven Principles to Design for Embodied Sensemaking

The TEI-community is based a various paradigms. We believe that the community matures by scrutinising these different paradigms and unravelling the consequences for designing for tangible, embedded and embodied interaction. In this paper we explore the consequences and possibilities of phenomenology-inspired embodied theory, and more specifically the concept of embodied sensemaking, i.e. human sensemaking using sensorimotor couplings to support social coordination between people. Based on our theoretical setting, we introduce seven design principles for developing face-to-face embodied sensemaking technology. We show in this paper how we used these principles to develop a mobile design and sensemaking studio for the encounter between two persons to sketch a future at the cross-section of their disciplines. By explaining these principles, we aim to show what embodied theory can bring the TEI-community, and invite others to do the same.

NOOT: a tool for sharing moments of reflection during creative meetings

We present a fully working prototype of NOOT, an interactive tangible system which supports (sharing of) moments of reflection during brainstorms. We discuss the iterative design process, informed by embodied situated cognition theory and by user studies in context using various versions of the prototype. Apart from a potentially useful product, NOOT served as a research-tool showing how physical materials and social interactions scaffold peoples sense-making efforts, and how technology might fit in to support this process

Radical clashes: what tangible interaction is made of

Driven by a critique of Ishii et als recent vision of Radical Atoms we call for a debate on the different conceptual paradigms underlying the TEI community and its activities. TEI was initiated to share and connect different perspectives, but we feel conceptual debate is lacking. To fuel this debate, we start with comparing two paradigms by examining the Radical Atoms proposal and balance it from our design-led perspective. Our aim with this paper is to revive the richness of TEIs multidisciplinary approach.

Empowering people with impairments: how participatory methods can inform the design of empowering artifacts

Participatory Design has developed methods that empower people with impairments to actively take part in the design process. Many designed artifacts for this target group likewise aim to empower their users in daily life. In this workshop, we share and relate best practices of both empowering methods and empowering designs. Participants are therefore invited to bring along cases of designing for- and with people with sensory-, cognitive- or social impairments. Our workshop consists of three parts: (1) Foregrounding empowering elements in PD methods using method stories, containing the backstory of a method put into practice; (2) Reflecting on technological artifacts, exploring the empowering qualities of person-artifact-context interaction; (3) constructing a critical synopsis of the various relationships between empowering products and - methods.

The Blue Studio: Designing an Interactive Environment for Embodied Multi-Stakeholder Ideation Processes

This paper describes the process of designing the Blue Studio: an interactive space for embodied multi-stakeholder ideation processes. Inspired by embodied sensemaking -- the way people make sense of things through external expression and interaction with other people -- we iteratively designed material, interactive and spatial interventions in the Blue Studio and evaluated them with multi-stakeholder participants in various studies. Thereupon, we analyzed the impact of the design interventions, based on the seven principles to design for embodied sensemaking and highlighted opportunities for refining our interactive space for embodied ideation. Based on the insights gained, a final design of the Blue Studio was realized and evaluated on functionality.

Being there, doing it: the challenge of embodied cognition for design

This workshop investigates how to apply embodied situated cognition to the design for interaction. Participants combine embodied experiences, prototyping and theory. We aim for deep-level linkage of theory and practice by uncovering some of the more complex challenges that embodiment presents in the context of concrete design cases.

Scaffolds for design communication : research through design of shared understanding in design meetings

Abstract In this paper we explore the influence of the physical and social environment (the design space) son the formation of shared understanding in multidisciplinary design teams. We concentrate on the creative design meeting as a microenvironment for studying processes of design communication. Our applied research context entails the design of mixed physical–digital interactive systems supporting design meetings. Informed by theories of embodiment that have recently gained interest in cognitive science, we focus on the role of interactive “traces,” representational artifacts both created and used by participants as scaffolds for creating shared understanding. Our research through design approach resulted in two prototypes that form two concrete proposals of how the environment may scaffold shared understanding in design meetings. In several user studies we observed users working with our systems in natural contexts. Our analysis reveals how an ensemble of ongoing social as well as physical interactions, scaffolded by the interactive environment, grounds the formation of shared understanding in teams. We discuss implications for designing collaborative tools and for design communication theory in general.In this paper we explore the influence of the physical and social environment (the design space) son the formation of shared understanding in multidisciplinary design teams. We concentrate on the creative design meeting as a microenvironment for studying processes of design communication. Our applied research context entails the design of mixed physical–digital interactive systems supporting design meetings. Informed by theories of embodiment that have recently gained interest in cognitive science, we focus on the role of interactive “traces,” representational artifacts both created and used by participants as scaffolds for creating shared understanding. Our research through design approach resulted in two prototypes that form two concrete proposals of how the environment may scaffold shared understanding in design meetings. In several user studies we observed users working with our systems in natural contexts. Our analysis reveals how an ensemble of ongoing social as well as physical interactions, scaffolded by the interactive environment, grounds the formation of shared understanding in teams. We discuss implications for designing collaborative tools and for design communication theory in general.

Designing for Participatory Sensemaking

In this Research-through-Design investigation we explore the value of embodiment for social interaction in collaborative settings, and how to support -- rather than suppress or ignore – this embodiment with interactive technology. We use Participatory Sensemaking (De Jaegher & Di Paolo, 2007), a theory which explains sensemaking as continuous embodied interactions between people in a shared action space. We discuss three prototypes supporting Participatory Sensemaking. We describe how our understanding of participatory sensemaking evolved through (reflections on) design. The first product creates tangible access to moments of reflection in group conversations. We came to understand the tangibles as traces of individual reflection, which become publicly observable and actionable within social interaction. In our second prototype we designed traces as floor-projections dynamically connected to people’s body movements. The system mediates the social positioning of participants. The final system integrates our earlier insights in a dialogue tool for two people. Here participatory sensemaking shows itself as a skill with special emphasis on the sensuality of mutual contact. We end with a more general reflection on how design can contribute to theoretical analysis through iterations of designing and observing what interactive artefacts concretely do within the full complexity of human practices.