Pascal Haazebroek

A computational model of perception and action for cognitive robotics.

Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.

How Task Goals Mediate the Interplay between Perception and Action

Theories of embodied cognition suppose that perception, action, and cognition are tightly intertwined and share common representations and processes. Indeed, numerous empirical studies demonstrate interaction between stimulus perception, response planning, and response execution. In this paper, we present an experiment and a connectionist model that show how the Simon effect, a canonical example of perception–action congruency, can be moderated by the (cognitive representation of the) task instruction. To date, no representational account of this influence exists. In the experiment, a two-dimensional Simon task was used, with critical stimuli being colored arrows pointing in one of four directions (backward, forward, left, or right). Participants stood on a Wii balance board, oriented diagonally toward the screen displaying the stimuli. They were either instructed to imagine standing on a snowboard or on a pair of skis and to respond to the stimulus color by leaning toward either the left or right foot. We expected that participants in the snowboard condition would encode these movements as forward or backward, resulting in a Simon effect on this dimension. This was confirmed by the results. The left–right congruency effect was larger in the ski condition, whereas the forward–backward congruency effect appeared only in the snowboard condition. The results can be readily accounted for by HiTEC, a connectionist model that aims at capturing the interaction between perception and action at the level of representations, and the way this interaction is mediated by cognitive control. Together, the empirical work and the connectionist model contribute to a better understanding of the complex interaction between perception, cognition, and action.

Requirements and platforms for social agents that alarm and support elderly living alone

Social embodied agents may mitigate moments of apathy and confusion that older adults can experience at home. Based on a literature study, use cases, requirements and claims were specified. In an experiment with 29 older adults (aged 70+), it was studied to what extent a virtual agent and three robots (i.e., the Nao, iCat and Nabaztag) provide a platform to support these use cases, requirements and claims. Participants seemed to evaluate the agents mainly in terms of three generic components: the perceived level of realism, intellectuality and friendliness. A more serious and agreeable appearance improved the appreciation of the agents actions. Especially facial realism appeared to be important for trust, social presence, perceived sociability and perceived enjoyment.

Towards a Computational Model of Perception and Action in Human Computer Interaction

The evaluation and design of user interfaces may be facilitated by using performance models based on cognitive architectures. A recent trend in Human Computer Interaction is the increased focus on perceptual and motor-related aspects of the interaction. With respect to this focus, we present the foundations of HiTEC, a new cognitive architecture based on recent findings of interactions between perception and action in the domain of cognitive psychology. This approach is contrasted with existing architectures.

A dynamic quality assessment tool for laparoscopic hysterectomy to measure surgical outcomes

BACKGROUNDnThe current health care system has an urgent need for tools to measure quality. A wide range of quality indicators have been developed in an attempt to differentiate between high-quality and low-quality health care processes. However, one of the main issues of currently used indicators is the lack of case-mix correction and improvement possibilities. Case-mix is defined as specific (patient) characteristics that are known to potentially affect (surgical) outcome. If these characteristics are not taken into consideration, comparisons of outcome among health care providers may not be valid.nnnOBJECTIVEnThe objective of the study was to develop and test a quality assessment tool for laparoscopic hysterectomy, which can serve as a new outcome quality indicator.nnnSTUDY DESIGNnThis is a prospective, international, multicenter implementation study. A web-based application was developed with 3 main goals: (1) to measure the surgeons performance using 3 primary outcomes (blood loss, operative time, and complications); (2) to provide immediate individual feedback using cumulative observed-minus-expected graphs; and (3) to detect consistently suboptimal performance after correcting for case-mix characteristics. All gynecologists who perform laparoscopic hysterectomies were requested to register their procedures in the application. A patient safety risk factor checklist was used by the surgeon for reflection. Thereafter a prospective implementation study was performed, and the application was tested using a survey that included the System Usability Scale.nnnRESULTSnA total of 2066 laparoscopic hysterectomies were registered by 81 gynecologists. Mean operative time was 100 ± 39 minutes, blood loss 127 ± 163 mL, and the complication rate 6.1%. The overall survey response rate was 75%, and the mean System Usability Scale was 76.5 ± 13.6, which indicates that the application was good to excellent. The majority of surgeons reported that the application made them more aware of their performance, the outcomes, and patient safety, and they noted that the application provided motivation for improving future performance.nnnCONCLUSIONnWe report the development and test of a real-time, dynamic, quality assessment tool for measuring individual surgical outcome for laparoscopic hysterectomy. Importantly, this tool provides opportunities for improving surgical performance. Our study provides a foundation for helping clinicians develop evidence-based quality indicators for other surgical procedures.

Anticipative Control of Voluntary Action: Towards a Computational Model

Human action is goal-directed and must thus be guided by anticipations of wanted action effects. How anticipatory action control is possible and how it can emerge from experience is the topic of the ideomotor approach to human action. The approach holds that movements are automatically integrated with representations of their sensory effects, so that reactivating the representation of a wanted effect by thinking of it leads to a reactivation of the associated movement. We present a broader theoretical framework of human perception and action control--the Theory of Event Coding (TEC)--that is based on the ideomotor principle, and discuss our recent attempts to implement TEC by means of a computational model (HiTEC) to provide an effective control architecture for artificial systems and cognitive robots.

Interaction between Task Oriented and Affective Information Processing in Cognitive Robotics

There is an increasing interest in endowing robots with emotions. Robot control however is still often very task oriented. We present a cognitive architecture that allows the combination of and interaction between task representations and affective information processing. Our model is validated by comparing simulation results with empirical data from experimental psychology.

HiTEC: a connectionist model of the interaction between perception and action planning

Increasing evidence suggests that perception and action planning do not represent separable stages of a unidirectional processing sequence, but rather emerging properties of highly interactive processes. To capture these characteristics of the human cognitive system, we have developed a connectionist model of the interaction between perception and action planning: HiTEC, based on the Theory of Event Coding (Hommel et al. in Behav Brain Sci 24:849–937, 2001). The model is characterized by representations at multiple levels and by shared representations and processes. It complements available models of stimulus–response translation by providing a rationale for (1) how situation-specific meanings of motor actions emerge, (2) how and why some aspects of stimulus–response translation occur automatically and (3) how task demands modulate sensorimotor processing. The model is demonstrated to provide a unitary account and simulation of a number of key findings with multiple experimental paradigms on the interaction between perception and action such as the Simon effect, its inversion (Hommel in Psychol Res 55:270–279, 1993), and action–effect learning.

Gamification to Engage Clinicians in Registering Data: A Randomized Trial

OBJECTIVEnTo determine the effect of additional gamification elements in a web-based registry system in terms of engagement and involvement to register outcome data, and to determine if gamification elements have any effect on clinical outcomes.nnnMETHODSnRandomized controlled trial for gynecologists to register their performed laparoscopic hysterectomies (LH) in an online application. Gynecologists were randomized for two types of registries. Both groups received access to the online application; after registering a procedure, direct individual feedback on surgical outcomes was provided by showing three proficiency graphs. In the intervention group, additionally gamification elements were shown. These gamification elements consisted of points and achievements that could be earned and insight in monthly collective scores. All gamification elements were based on positive enforcement.nnnRESULTSnA total of 71 gynecologists were randomized and entered a total of 1833 LH procedures. No significant difference was found between the groups in terms of engagement and involvement on a 5-point Likert scale, respectively 2.34±0.87 versus 2.56±1.05 and 3.63±0.57 versus 3.33±1.03 for the intervention versus the control group (p>0.05). The intervention group showed longer operative time than the control group (108±42 vs. 101±34 minutes, p=0.04), no other differences were found in terms of surgical outcomes.nnnCONCLUSIONSnThe addition of gamification elements in a registry system did not enhance the engagement and involvement of clinicians to register their clinical data. Based on our results, we advise that registry systems for clinical data should be as simple as possible with the focus on the main goal of the registry.