Lior Noy

The mirror game as a paradigm for studying the dynamics of two people improvising motion together

Joint improvisation is the creative action of two or more people without a script or designated leader. Examples include improvisational theater and music, and day-to-day activities such as conversations. In joint improvisation, novel action is created, emerging from the interaction between people. Although central to creative processes and social interaction, joint improvisation remains largely unexplored due to the lack of experimental paradigms. Here we introduce a paradigm based on a theater practice called the mirror game. We measured the hand motions of two people mirroring each other at high temporal and spatial resolution. We focused on expert actors and musicians skilled in joint improvisation. We found that players can jointly create novel complex motion without a designated leader, synchronized to less than 40 ms. In contrast, we found that designating one player as leader deteriorated performance: The follower showed 2–3 Hz oscillation around the leaders smooth trajectory, decreasing synchrony and reducing the range of velocities reached. A mathematical model suggests a mechanism for these observations based on mutual agreement on future motion in mirrored reactive–predictive controllers. This is a step toward understanding the human ability to create novelty by improvising together.

Individuality and togetherness in joint improvised motion.

Actors, dancers and musicians that improvise together report special moments of togetherness: high performance and synchrony, seemingly without a leader and a follower. Togetherness seems to conflict with individuality- the idiosyncratic character of each persons performance. To understand the relation of individuality and togetherness, we employed the mirror game paradigm in which two players are asked to mirror each other and create interesting synchronized motion, with and without a designated leader. The mirror game enables quantitative characterization of moments of togetherness in which complex motion is generated with high synchrony. We find that each person as a leader does basic strokes of motion with a characteristic signature, in terms of the shape of their velocity profile between two stopping events. In moments of togetherness both players change their signature to a universal stroke shape. This universal velocity profile resembles a half-period of a sine wave, and is therefore symmetric and maximally smooth. Thus, instead of converging to an intermediate motion signature, or having one player dominate, players seem to shift their basic motion signatures to a shape that is altogether different from their individually preferred shapes; the resulting motion may be easier to predict and to agree on. The players then build complex motion by using such smooth elementary strokes.

Being in the zone: physiological markers of togetherness in joint improvisation

Performers improvising together describe special moments of ‘being in the zone’ – periods of high performance, synchrony, and enhanced sense of togetherness. Existing evidence suggests a possible route for attaining togetherness – interpersonal synchrony, the fine-grained sensory-motor coordination that promotes social connectedness. Here, we investigated the physiological characteristics of togetherness using a practice from theater and dance, the mirror game. Pairs of expert improvisers jointly improvised synchronized linear motion, while their motion tracks and cardiovascular activity were continuously monitored. Players also provided dynamic ratings of togetherness while watching video recordings of their games. We identified periods of togetherness using kinematic and subjective markers and assessed their physiological characteristics. The kinematic and the subjective measures of togetherness showed some agreement, with more extensive game periods being marked by the subjective than the kinematic one. Game rounds with high rates of togetherness were characterized by increased players’ cardiovascular activity, increased correlation of players’ heart rates (HRs), and increased motion intensity. By comparing motion segments with similar motion intensity, we showed that moments of togetherness in the mirror game were marked by increased players’ HRs, regardless of motion intensity. This pattern was robust for the subjectively defined periods of togetherness, while showing a marginal effect for the kinematically defined togetherness. Building upon similar findings in flow research we suggest that the observed increase of players’ HRs during togetherness periods in the mirror game might indicate the enhanced engagement and enjoyment reported by performers going into ‘the zone.’ The suggested approach, combining temporal measurements of kinematic, physiological and subjective responses, demonstrates how the dynamics of spontaneously emerging dyadic states can be studied empirically.

Would you like to play together? Adults’ attachment and the mirror game

ABSTRACT Why is it easy for some people to play together and difficult for others? In this interdisciplinary pilot study, we looked at dyadic interaction in motion as a paradigm to explore the expression of attachment in adulthood. We used a device that gives simple, quantitative and automated indicators for the quality of interaction while playing the mirror game. Forty-seven participants played the mirror game with the same gender-matched expert players. In addition, participants were interviewed on the Adult Attachment Interview to assess their quality of attachment. Using high resolution kinematic measures, we found that secure attachment was correlated with high complexity of the game and low synchrony compared to insecure attachment. The findings suggest that security of attachment is related to a more exploratory and less rigid game than insecure-dismissing attachment. These preliminary findings imply that high resolution analysis of simple movement interaction could carry information about attachment behavior.

Simple Movement Imitation: Are Kinematic Features Sufficient to Map Perceptions into Actions?.

The aim of this study was to pinpoint the nature of the visual features used in the automatic mapping of perceived movements into similar executed movements, following the direct matching hypothesis. In Experiment 1 subjects imitated the lifting of one of two fingers, presented with different orientations. As predicted, stimuli which were further rotated away from the posture of the executing hand elicited slower reaction times. In Experiment 2, we verified that this orientation effect was not a purely perceptual effect by presenting the same stimuli but asking subjects to respond verbally. No orientation effect was found using a verbal response. In Experiment 3, we replaced the moving fingers by two arbitrary objects moving with the trajectories of the finger tips of Experiment 1. The same orientation effect as in Experiment 1 was observed. We conclude that in this experiment participants are using purely kinematic features to map perceived into executed movements.

Exit from Synchrony in Joint Improvised Motion

Motion synchrony correlates with effective and well-rated human interaction. However, people do not remain locked in synchrony; Instead, they repeatedly enter and exit synchrony. In many important interactions, such as therapy, marriage and parent-infant communication, it is the ability to exit and then re-enter synchrony that is thought to build strong relationship. The phenomenon of entry into zero-phase synchrony is well-studied experimentally and in terms of mathematical modeling. In contrast, exit-from-synchrony is under-studied. Here, we focus on human motion coordination, and examine the exit-from-synchrony phenomenon using experimental data from the mirror game paradigm, in which people perform joint improvised motion, and from human tracking of computer-generated stimuli. We present a mathematical mechanism that captures aspects of exit-from-synchrony in human motion. The mechanism adds a random motion component when the accumulated velocity error between the players is small. We introduce this mechanism to several models for human coordinated motion, including the widely studied HKB model, and the predictor-corrector model of Noy, Dekel and Alon. In all models, the new mechanism produces realistic simulated behavior when compared to experimental data from the mirror game and from tracking of computer generated stimuli, including repeated entry and exit from zero-phase synchrony that generates a complexity of motion similar to that of human players. We hope that these results can inform future research on exit-from-synchrony, to better understand the dynamics of coordinated action of people and to enhance human-computer and human-robot interaction.

Creative foraging: An experimental paradigm for studying exploration and discovery

Creative exploration is central to science, art and cognitive development. However, research on creative exploration is limited by a lack of high-resolution automated paradigms. To address this, we present such an automated paradigm, the creative foraging game, in which people search for novel and valuable solutions in a large and well-defined space made of all possible shapes made of ten connected squares. Players discovered shape categories such as digits, letters, and airplanes as well as more abstract categories. They exploited each category, then dropped it to explore once again, and so on. Aligned with a prediction of optimal foraging theory (OFT), during exploration phases, people moved along meandering paths that are about three times longer than the shortest paths between shapes; when exploiting a category of related shapes, they moved along the shortest paths. The moment of discovery of a new category was usually done at a non-prototypical and ambiguous shape, which can serve as an experimental proxy for creative leaps. People showed individual differences in their search patterns, along a continuum between two strategies: a mercurial quick-to-discover/quick-to-drop strategy and a thorough slow-to-discover/slow-to-drop strategy. Contrary to optimal foraging theory, players leave exploitation to explore again far before categories are depleted. This paradigm opens the way for automated high-resolution study of creative exploration.

Placebo can enhance creativity

Background The placebo effect is usually studied in clinical settings for decreasing negative symptoms such as pain, depression and anxiety. There is interest in exploring the placebo effect also outside the clinic, for enhancing positive aspects of performance or cognition. Several studies indicate that placebo can enhance cognitive abilities including memory, implicit learning and general knowledge. Here, we ask whether placebo can enhance creativity, an important aspect of human cognition. Methods Subjects were randomly assigned to a control group who smelled and rated an odorant (n = 45), and a placebo group who were treated identically but were also told that the odorant increases creativity and reduces inhibitions (n = 45). Subjects completed a recently developed automated test for creativity, the creative foraging game (CFG), and a randomly chosen subset (n = 57) also completed two manual standardized creativity tests, the alternate uses test (AUT) and the Torrance test (TTCT). In all three tests, participants were asked to create as many original solutions and were scored for originality, flexibility and fluency. Results The placebo group showed higher originality than the control group both in the CFG (p<0.04, effect size = 0.5) and in the AUT (p<0.05, effect size = 0.4), but not in the Torrance test. The placebo group also found more shapes outside of the standard categories found by a set of 100 CFG players in a previous study, a feature termed out-of-the-boxness (p<0.01, effect size = 0.6). Conclusions The findings indicate that placebo can enhance the originality aspect of creativity. This strengthens the view that placebo can be used not only to reduce negative clinical symptoms, but also to enhance positive aspects of cognition. Furthermore, we find that the impact of placebo on creativity can be tested by CFG, which can quantify multiple aspects of creative search without need for manual coding. This approach opens the way to explore the behavioral and neural mechanisms by which placebo might amplify creativity.

Patterns of Joint Improvisation in Adults with Autism Spectrum Disorder

Recent research on autism spectrum disorders (ASDs) suggests that individuals with autism may have a basic deficit in synchronizing with others, and that this difficulty may lead to more complex social and communicative deficits. Here, we examined synchronization during an open-ended joint improvisation (JI) paradigm, called the mirror game (MG). In the MG, two players take turns leading, following, and jointly improvising motion using two handles set on parallel tracks, while their motion tracks are recorded with high temporal and spatial resolution. A series of previous studies have shown that players in the MG attain moments of highly synchronized co-confident (CC) motion, in which there is no typical kinematic pattern of leader and reactive follower. It has been suggested that during these moments players act as a coupled unit and feel high levels of connectedness. Here, we aimed to assess whether participants with ASD are capable of attaining CC, and whether their MG performance relates to broader motor and social skills. We found that participants with ASD (n = 34) can indeed attain CC moments when playing with an expert improviser, though their performance was attenuated in several ways, compared to typically developing (TD) participants (n = 35). Specifically, ASD participants had lower rates of CC, compared with TD participants, which was most pronounced during the following rounds. In addition, the duration of their CC segments was shorter, across all rounds. When controlling for participants’ motor skills (both on the MG console, and more broadly) some of the variability in MG performance was explained, but group differences remained. ASD participants’ alexithymia further correlated with their difficulty following another’s lead; though other social skills did not relate to MG performance. Participants’ subjective reports of the game suggest that other cognitive and emotional factors, such as attention, motivation, and reward-processing, which were not directly measured in the experiment, may impact their performance. Together, these results show that ASD participants can attain moments of high motor synchronization with an expert improviser, even during an open-ended task. Future studies should examine the ways in which these skills may be further harnessed in clinical settings.

Synchrony in Joint Action Is Directed by Each Participant’s Motor Control System

In this work, we ask how the probability of achieving synchrony in joint action is affected by the choice of motion parameters of each individual. We use the mirror game paradigm to study how changes in leader’s motion parameters, specifically frequency and peak velocity, affect the probability of entering the state of co-confidence (CC) motion: a dyadic state of synchronized, smooth and co-predictive motions. In order to systematically study this question, we used a one-person version of the mirror game, where the participant mirrored piece-wise rhythmic movements produced by a computer on a graphics tablet. We systematically varied the frequency and peak velocity of the movements to determine how these parameters affect the likelihood of synchronized joint action. To assess synchrony in the mirror game we used the previously developed marker of co-confident (CC) motions: smooth, jitter-less and synchronized motions indicative of co-predicative control. We found that when mirroring movements with low frequencies (i.e., long duration movements), the participants never showed CC, and as the frequency of the stimuli increased, the probability of observing CC also increased. This finding is discussed in the framework of motor control studies showing an upper limit on the duration of smooth motion. We confirmed the relationship between motion parameters and the probability to perform CC with three sets of data of open-ended two-player mirror games. These findings demonstrate that when performing movements together, there are optimal movement frequencies to use in order to maximize the possibility of entering a state of synchronized joint action. It also shows that the ability to perform synchronized joint action is constrained by the properties of our motor control systems.