Thomas F. Shipley

A theory of visual interpolation in object perception

We describe a new theory explaining the perception of partly occluded objects and illusory figures, from both static and kinematic information, in a unified framework. Three ideas guide our approach. First, perception of partly occluded objects, perception of illusory figures, and some other object perception phenomena derive from a single boundary interpolation process. These phenomena differ only in respects that are not part of the unit formation process, such as the depth placement of units formed. Second, unit formation from static and kinematic information can be treated in the same general framework. Third, spatial and spatiotemporal discontinuities in the boundaries of optically projected areas are fundamental to the unit formation process. Consistent with these ideas, we develop a detailed theory of unit formation that accounts for most cases of boundary perception in the absence of local physical specification. According to this theory, discontinuities in the first derivative of projected edges are initiating conditions for unit formation. A formal notion of relatability is defined, specifying which physically given edges leading into discontinuities can be connected to others by interpolated edges. Intuitively, relatability requires that two edges be connectable by a smooth, monotonic curve. The roots of the discontinuity and relatability notions in ecological constraints on object perception are discussed. Finally, we elaborate our approach by discussing related issues, some new phenomena, connections to other approaches, and issues for future research.

Strength of visual interpolation depends on the ratio of physically specified to total edge length

We report four experiments in which the strength ofedge-interpoiat-ion in illusory figure displays was tested. In Experiment 1, we investigated the relative contributions of the lengths of luminance-specified edges and the gaps between them to perceived boundary clarity as measured by using a magnitude estimation procedure. The contributionaoLthese variables were found to be best characterized by a ratio of the length of luminance-specified contour to the length of the entire edge (specified plus interpolated edge). Experiment 2 showed that this ratio predicts boundary clarity for a wide range of ratio values and display sizes.There was no evidence that illusory figure boundaries are clearer in displays with small gaps than they are in displays with larger gaps and equivalent ratios. In Experiment 3, using a more sensitive pairwise comparison paradigm, we again found no such effect. Implications for boundary interpolation in general, including perception of partially occluded objects, are discussed. The dependence of interpolation on the ratio of physically specified edges to total edgelength has thedesirable eeological consequence that unit formation will not change with variations in viewing distance.

The Effect of Object and Event Orientation on Perception of Biological Motion

Detection and recognition of point-light walking is reduced when the display is inverted, or turned upside down. This indicates that past experience influences biological motion perception. The effect could be the result of either presenting the human form in a novel orientation or presenting the event of walking in a novel orientation, as the two are confounded in the case of walking on feet. This study teased apart the effects of object and event orientation by examining detection accuracy for upright and inverted displays of a point-light figure walking on his hands. Detection of this walker was greater in the upright display, which had a familiar event orientation and an unfamiliar object orientation, than in the inverted display, which had a familiar object orientation and an unfamiliar event orientation. This finding supports accounts of event perception and recognition that are based on spatiotemporal patterns of motion associated with the dynamics of an event.

A common mechanism for illusory and occluded object completion.

New phenomena and results are reported that implicate a common contour interpolation mechanism in illusory and occluded (modal and amodal) object completion. In 3 experiments, a speeded classification task was used to study novel quasimodal displays in which occluded and illusory contours join. Results showed the same advantages in speed and accuracy over control displays for quasimodal, illusory, and occluded displays. The implications of quasimodal displays, along with another new display type in which contour linkages must precede determination of modal or amodal appearance, are considered. These logical considerations and empirical results suggest that amodal and modal completion depend on a common underlying mechanism that connects edges across gaps.

Getting Lost in Buildings

People often get lost in buildings, including but not limited to libraries, hospitals, conference centers, and shopping malls. There are at least three contributing factors: the spatial structure of the building, the cognitive maps that users construct as they navigate, and the strategies and spatial abilities of the building users. The goal of this article is to discuss recent research on each of these factors and to argue for an integrative framework that encompasses these factors and their intersections, focusing on the correspondence between the building and the cognitive map, the completeness of the cognitive map as a function of the strategies and individual abilities of the users, the compatibility between the building and the strategies and individual abilities of the users, and complexity that emerges from the intersection of all three factors. We end with an illustrative analysis in which we apply this integrative framework to difficulty in way-finding.

Surface completion complements boundary interpolation in the visual integration of partly occluded objects.

Previous research on perceptual completion has emphasized how the spatial relationships of edges influence the visual integration of the image fragments that result from partial occlusion. We report studies testing the hypothesis that the similarity of surface features also influences visual integration, complementing edge interpolation processes. Using displays that separated edge interpolation processes from surface-feature interpolation processes, we tested the hypotheses that a surface completion process integrates image fragments with similar surface features, and that surface completion is constrained by amodally interpolated and amodally extended boundaries. Both edge relatability and surface-feature similarity were manipulated in a series of paired-comparison and classification tasks. The results of these studies supported the hypotheses and were extended to surface features of colors, textures, and color gradients. Results also suggest that, under certain conditions, surface completion may interact with and influence edge interpolation.

Hippocampal size predicts rapid learning of a cognitive map in humans.

The idea that humans use flexible map‐like representations of their environment to guide spatial navigation has a long and controversial history. One reason for this enduring controversy might be that individuals vary considerably in their ability to form and utilize cognitive maps. Here we investigate the behavioral and neuroanatomical signatures of these individual differences. Participants learned an unfamiliar campus environment over a period of three weeks. In their first visit, they learned the position of different buildings along two routes in separate areas of the campus. During the following weeks, they learned these routes for a second and third time, along with two paths that connected both areas of the campus. Behavioral assessments after each learning session indicated that subjects formed a coherent representation of the spatial structure of the entire campus after learning a single connecting path. Volumetric analyses of structural MRI data and voxel‐based morphometry (VBM) indicated that the size of the right posterior hippocampus predicted the ability to use this spatial knowledge to make inferences about the relative positions of different buildings on the campus. An inverse relationship between gray matter volume and performance was observed in the caudate. These results suggest that (i) humans can rapidly acquire cognitive maps of large‐scale environments and (ii) individual differences in hippocampal anatomy may provide the neuroanatomical substrate for individual differences in the ability to learn and flexibly use these cognitive maps.

Surface integration influences depth discrimination

Image fragments arising from partial occlusion may be perceptually unified by a surface integration process on the basis of similar color or texture. In a new objective measure pitting surface feature similarity against binocular disparity, observers discriminated whether a colored circle had either crossed or uncrossed disparity relative to a surrounding gray rectangle. Sensitivity to disparity was impaired only when (1) the configuration of the other surface fragments in the display supported the integration of a surface behind the rectangle and circle, and (2) matched the color of the central circle. Results were consistent with the hypothesis that a surface integration process integrated similarly-colored surface fragments into a smooth surface, even when those fragments were at different depths. Surface integration caused small and reliable effects on depth perception despite unambiguous disparity information. Perceived depth does not depend solely upon disparity, and may be determined after three-dimensional figural unity is established.

Spatiotemporal boundary formation: boundary, form, and motion perception from transformations of surface elements

Continuous surface boundaries, object shape, and global motion can be perceived from information that is fragmentary in both space and time. The authors report investigations indicating that accretion and deletion of texture is only 1 member of a broader class of element transformations that produce boundaries, shape, and motion, through spatiotemporal boundary formation (SBF). The authors report 4 experiments exploring SBF. The first 3 examine the class of transformations producing SBF, indicating that local element changes in color, orientation, or location are all effective. A 4th experiment examines temporal constraints on SBF. Integration of local element changes to produce boundaries, form, and global motion appears to be confined to a 165-ms window. Two classes of spatiotemporal integration models are considered; the relation between SBF and other cases of boundary interpolation are discussed.

The role of discontinuities in the perception of subjective figures

Recently we proposed a theory of visual interpolation (Kellman & Shipley, in press) that addresses a variety of unit formation phenomena, including the perception of partly occluded objects and subjective figures. A basic notion of the theory is that discontinuities in the first derivative of projected edges are the initiating conditions for interpolation of boundaries that are not physically specified. In this paper, we report four experiments in which this claim was tested in the domain of subjective figures. Experiments 1 and 2 demonstrate that discontinuities in the first derivative of the edges of inducing elements have a clear effect on the frequency of report and the perceived clarity of simple subjective figures. Similar effects are found when unfamiliar subjective figures and inducing elements are used (Experiment 3). Experiment 4 rules out the possibility that the discontinuities in the first derivative merely add to the clarity of subjective figures. These experiments suggest that first-order discontinuities play a central role in unit formation.