Andrea Flumini

One hand, two objects: emergence of affordance in contexts.

Studies on affordances typically focus on single objects. We investigated whether affordances are modulated by the context, defined by the relation between two objects and a hand. Participants were presented with pictures displaying two manipulable objects linked by a functional (knife-butter), a spatial (knife-coffee mug), or by no relation. They responded by pressing a key whether the objects were related or not. To determine if observing others actions and understanding their goals would facilitate judgments, a hand was: (a) displayed near the objects; (b) grasping an object to use it; (c) grasping an object to manipulate/move it; (d) no hand was displayed. RTs were faster when objects were functionally rather than spatially related. Manipulation postures were the slowest in the functional context and functional postures were inhibited in the spatial context, probably due to mismatch between the inferred goal and the context. The absence of this interaction with foot responses instead of hands in Experiment 2 suggests that effects are due to motor simulation rather than to associations between context and hand-postures.

Manipulating Objects and Telling Words: A Study on Concrete and Abstract Words Acquisition

Four experiments (E1–E2–E3–E4) investigated whether different acquisition modalities lead to the emergence of differences typically found between concrete and abstract words, as argued by the words as tools (WAT) proposal. To mimic the acquisition of concrete and abstract concepts, participants either manipulated novel objects or observed groups of objects interacting in novel ways (Training 1). In TEST 1 participants decided whether two elements belonged to the same category. Later they read the category labels (Training 2); labels could be accompanied by an explanation of their meaning. Then participants observed previously seen exemplars and other elements, and were asked which of them could be named with a given label (TEST 2). Across the experiments, it was more difficult to form abstract than concrete categories (TEST 1); even when adding labels, abstract words remained more difficult than concrete words (TEST 2). TEST 3 differed across the experiments. In E1 participants performed a feature production task. Crucially, the associations produced with the novel words reflected the pattern evoked by existing concrete and abstract words, as the first evoked more perceptual properties. In E2–E3–E4, TEST 3 consisted of a color verification task with manual/verbal (keyboard–microphone) responses. Results showed the microphone use to have an advantage over keyboard use for abstract words, especially in the explanation condition. This supports WAT: due to their acquisition modality, concrete words evoke more manual information; abstract words elicit more verbal information. This advantage was not present when linguistic information contrasted with perceptual one. Implications for theories and computational models of language grounding are discussed.

Visual context modulates potentiation of grasp types during semantic object categorization

Substantial evidence suggests that conceptual processing of manipulable objects is associated with potentiation of action. Such data have been viewed as evidence that objects are recognized via access to action features. Many objects, however, are associated with multiple actions. For example, a kitchen timer may be clenched with a power grip to move it but pinched with a precision grip to use it. The present study tested the hypothesis that action evocation during conceptual object processing is responsive to the visual scene in which objects are presented. Twenty-five healthy adults were asked to categorize object pictures presented in different naturalistic visual contexts that evoke either move- or use-related actions. Categorization judgments (natural vs. artifact) were performed by executing a move- or use-related action (clench vs. pinch) on a response device, and response times were assessed as a function of contextual congruence. Although the actions performed were irrelevant to the categorization judgment, responses were significantly faster when actions were compatible with the visual context. This compatibility effect was largely driven by faster pinch responses when objects were presented in use-compatible, as compared with move-compatible, contexts. The present study is the first to highlight the influence of visual scene on stimulus–response compatibility effects during semantic object processing. These data support the hypothesis that action evocation during conceptual object processing is biased toward context-relevant actions.

How do you hold your mouse? Tracking the compatibility effect between hand posture and stimulus size.

In keeping with the idea that observing objects activates possible motor responses, several experiments revealed compatibility effects between the hand postures used to report a choice and some characteristics of the stimuli. The real-time dynamics of such compatibility effects are currently unknown. We tracked the time course of a categorization experiment requiring subjects to categorize as natural or artifact figures of big and small objects. Participants reported their choice using either a big mouse (requiring a power grip: a hand posture compatible with the grasping of big objects) or a small mouse (requiring a precision grip: a hand posture compatible with the grasping of small objects). We found a compatibility effect between the grip required by the mouse and the grip elicited by objects, even if it was irrelevant to the task. In a following experiment with the same paradigm, lexical stimuli failed to reproduce the same effect. Nevertheless, a compatibility effect mediated by the target-word category (artificial vs. natural) was observed. We discuss the results in the context of affordance effects literature and grounded theories of cognition.

Reading and writing direction effects on the aesthetic appreciation of photographs.

ABSTRACT Does reading and writing direction (RWD) influence the aesthetic appreciation of photography? Pérez González showed that nineteenth-century Iranian and Spanish professional photographers manifest lateral biases linked to RWD in their compositions. The present study aimed to test whether a population sample showed similar biases. Photographs with left-to-right (L–R) and right-to-left (R–L) directionality were selected from Pérez González’s collections and presented in both original and mirror-reversed forms to Spanish (L–R readers) and Moroccan (R–L readers) participants. In Experiment 1, participants rated each picture for its aesthetic pleasingness. The results showed neither effects of lateral organization nor interactions with RWD. In Experiment 2, each picture and its mirror version were presented together and participants chose the one they liked better. Spaniards preferred rightward versions and Moroccans preferred leftward versions. RWD therefore affects aesthetic impressions of photography in our participants when people pay attention to the lateral spatial dimension of pictures. The observed directional aesthetic preferences were not sensitive to the sex of the model in the photographs, failing to support expectations from the hypotheses of emotionality and agency. Preferences were attributable to the interaction between general scanning strategies and scanning habits linked to RWD.

Reading direction causes spatial biases in mental model construction in language understanding.

Correlational evidence suggests that the experience of reading and writing in a certain direction is able to induce spatial biases at both low-level perceptuo-motor skills and high-level conceptual representations. However, in order to support a causal relationship, experimental evidence is required. In this study, we asked whether the direction of the script is a sufficiente cause of spatial biases in the mental models that understanders build when listening to language. In order to establish causality, we manipulated the experience of reading a script with different directionalities. Spanish monolinguals read either normal (left-to-right), mirror reversed (right-to-left), rotated downward (up-down), or rotated upward (down-up) texts, and then drew the contents of auditory descriptions such as “the square is between the cross and the triangle”. The directionality of the drawings showed that a brief reading experience is enough to cause congruent and very specific spatial biases in mental model construction. However, there were also clear limits to this flexibility: there was a strong overall preference to arrange the models along the horizontal dimension. Spatial preferences when building mental models from language are the results of both short-term and long-term biases.

Scanning of speechless comics changes spatial biases in mental model construction

The mental representation of both time and number shows lateral spatial biases, which can be affected by habitual reading and writing direction. However, this effect is in place before children begin to read. One potential early cause is the experiences of looking at picture books together with a carer, as those images also follow the directionality of the script. What is the underlying mechanism for this effect? In the present study, we test the possibility that such experiences induce spatial biases in mental model construction, a mechanism which is a good candidate to induce the biases observed with numbers and times. We presented a speechless comic in either standard (left-to-right) or mirror-reversed (right-to-left) form to adult Spanish participants. We then asked them to draw the scene depicted by sentences like ‘the square is between the cross and the circle’. The position of the lateral objects in these drawings reveals the spatial biases at work when building mental models in working memory. Under conditions of highly consistent directionality, the mirror comic changed pre-existing lateral biases. Processes of mental model construction in working memory stand as a potential mechanism for the generation of spatial biases for time and number. This article is part of the theme issue ‘Varieties of abstract concepts: development, use and representation in the brain’.

Odors, words and objects

The paper focuses on concepts and words referring to odors and to objects that have an odor. We argue that odors are an interesting object of study since they are evanescent, and since odor words do not refer to concrete and manipulable objects, but to scents evoked by objects. A second reason why odors are interesting is that some languages, as the Western ones, lack a specific odor lexicon, comparable in richness and variety to the color lexicon, and that performance on odors naming is typically worse than performance in color naming. In this work we discuss three main issues. First, we illustrate literature showing that, even if odor words do not have concrete referents, many languages encode them quite easily: the case of odors suggests that word meaning cannot be exhausted by the relationship with a referent, and highlights the importance of the social sharing of meaning. Second, we have discussed the peculiar status of odor concepts and words. Given their ambiguous status, their simple existence poses problems both to theories according to which concrete and abstract concepts do not differ, and to theories according to which they represent a dichotomy. Finally, we present an experiment in which we show that names of objects evoke their smell, and that these smells evoke approach and avoidance movements, in line with theories according to which words are grounded in both sensorial and motor systems.