Vonne van Polanen

Haptic pop-out of movable stimuli

When, in visual and haptic search, a target is easily found among distractors, this is called a pop-out effect. The target feature is then believed to be salient, and the search is performed in a parallel way. We investigated this effect with movable stimuli in a haptic search task. The task was to find a movable ball among anchored distractors or the other way round. Results show that reaction times were independent of the number of distractors if the movable ball was the target but increased with the number of items if the anchored ball was the target. Analysis of hand movements revealed a parallel search strategy, shorter movement paths, a higher average movement speed, and a narrower direction distribution with the movable target, as compared with a more detailed search for an anchored target. Taken together, these results show that a movable object pops out between anchored objects and this indicates that movability is a salient object feature. Vibratory signals resulting from the movable ball were found to be a reasonable explanation regarding the sensation responsible for the pop-out of movability.

Haptic Search for Hard and Soft Spheres

In this study the saliency of hardness and softness were investigated in an active haptic search task. Two experiments were performed to explore these properties in different contexts. In Experiment 1, blindfolded participants had to grasp a bundle of spheres and determine the presence of a hard target among soft distractors or vice versa. If the difference in compliance between target and distractors was small, reaction times increased with the number of items for both features; a serial strategy was found to be used. When the difference in compliance was large, the reaction times were independent of the number of items, indicating a parallel strategy. In Experiment 2, blindfolded participants pressed their hand on a display filled with hard and soft items. In the search for a soft target, increasing reaction times with the number of items were found, but the location of target and distractors appeared to have a large influence on the search difficulty. In the search for a hard target, reaction times did not depend on the number of items. In sum, this showed that both hardness and softness are salient features.

Integration and disruption effects of shape and texture in haptic search

In a search task, where one has to search for the presence of a target among distractors, the target is sometimes easily found, whereas in other searches it is much harder to find. The performance in a search task is influenced by the identity of the target, the identity of the distractors and the differences between the two. In this study, these factors were manipulated by varying the target and distractors in shape (cube or sphere) and roughness (rough or smooth) in a haptic search task. Participants had to grasp a bundle of items and determine as fast as possible whether a predefined target was present or not. It was found that roughness and edges were relatively salient features and the search for the presence of these features was faster than for their absence. If the task was easy, the addition of these features could also disrupt performance, even if they were irrelevant for the search task. Another important finding was that the search for a target that differed in two properties from the distractors was faster than a task with only a single property difference, although this was only found if the two target properties were non-salient. This means that shape and texture can be effectively integrated. Finally, it was found that edges are more beneficial to a search task than disrupting, whereas for roughness this was the other way round.

Target contact and exploration strategies in haptic search

In a haptic search task, one has to detect the presence of a target among distractors using the sense of touch. A salient target can be detected faster than a non-salient target. However, little is known about the exploration strategies that are used, especially in 3D search tasks where items are held in the hand. In this study, we investigated which parts of the hand were used to contact the target and which strategies were performed. Blindfolded participants performed search tasks in four conditions, where the targets differed in relevant property and saliency. The positions of the target and the hand were tracked during exploration. It was found that target saliency had a large effect on the use of the hand parts and the strategies. In the non-salient target conditions, the fingers, especially the thumb, contacted the target more often than in the salient target conditions. This could also be seen in the strategies, where the thumb was used to explore the items in a serial way by moving them in the hand or touching them individually. In the salient target conditions, more parallel strategies like grasping or shuffling of the items in the hand were used.

Movement strategies in a haptic search task

Movement strategies were investigated in a haptic search task where participants indicated whether a target was present among a varying number of items. Hand movements were classified according to two criteria into three movement types. Results indicated that an easy search was performed with a parallel strategy, while in a more difficult search a serial movement strategy is used. Short, fluent movements were made in the easy search, whereas the difficult search showed more detailed movements and this amount increased when more items were to be searched. These differences between the search tasks remained when corrected for travelled distance, while path length could partly explain dissimilarities between trials with a target present and absent. Overall, these results indicate that movement strategies are adjusted primarily to the search condition and the salience of the target, and less to the presence of a target and set size.

Parallel processing of shape and texture in haptic search

In a haptic search task, one has to determine the presence of a target among distractors. It has been shown that if the target differs from the distractors in two properties, shape and texture, performance is better than in both single-property conditions (Van Polanen, Bergmann Tiest, & Kappers, 2013). The search for a smooth sphere among rough cubical distractors was faster than both the searches for a rough sphere (shape information only) and for a smooth cube (texture information only). This effect was replicated in this study as a baseline. The main focus here was to further investigate the nature of this integration. It was shown that performance is better when the two properties are combined in a single target (smooth sphere), than when located in two separate targets (rough sphere and smooth cube) that are simultaneously present. A race model that assumes independent parallel processing of the two properties could explain the enhanced performance with two properties, but this could only take place effectively when the two properties were located in a single target.

The role of connectedness in haptic object perception

We can efficiently detect whether there is a rough object among a set of smooth objects using our sense of touch. We can also quickly determine the number of rough objects in our hand. In this study, we investigated whether the perceptual processing of rough and smooth objects is influenced if these objects are connected. In Experiment 1, participants were asked to identify whether there were exactly two rough target spheres among smooth distractor spheres, while we recorded their response times. The spheres were connected to form pairs: rough spheres were paired together and smooth spheres were paired together (‘within pairs arrangement’), or a rough and a smooth sphere were connected (‘between pairs arrangement’). Participants responded faster when the spheres in a pair were identical. In Experiment 2, we found that the advantage for within pairs arrangements was not driven by feature saliency. Overall our results show that haptic information is processed faster when targets were connected together compared to when targets were connected to distractors.

A Simple Model of the Hand for the Analysis of Object Exploration

When hand motions in haptic exploration are investigated, the measurement methods used might actually restrict the movements or the perception. The perception might be reduced because the skin is covered, e.g. with a data glove. Also, the range of possible motions might be limited, e.g. by wired sensors. Here, a model of the hand is proposed that is calculated from data obtained from a small number of sensors (6). The palmar side of the hand is not covered by sensors or tape, leaving the skin free for cutaneous perception. The hand is then modeled as 16 rigid 3D segments, with a hand palm and 5 individual fingers with 3 phalanges each. This model can be used for movement analysis in object exploration and contact point analysis. A validation experiment of an object manipulation task and a contact analysis showed good qualitative agreement of the model with the control measurements. The calculations, assumptions and limitations of the model are discussed in comparison with other methods.

Optimal exploration strategies in haptic search

In this study, we have investigated which strategies were optimal in different haptic search tasks, where items were held in the hand. Blindfolded participants had to detect the presence of a target among distractors while using predetermined strategies. The optimal strategy was determined by considering reaction time and error data. In the search for salient targets, a rough sphere among smooth or a cube among spheres, parallel strategies were optimal. With non-salient targets, the results were different. In the search for a sphere among cubes, a parallel strategy was effective, but only if the fingers could be used. In the search for a smooth sphere among rough, only a serial strategy was successful. Thus, the optimal strategy depended on the required perceptual information.