Riccardo Caccavale

Attentional regulations in a situated human-robot dialogue

We propose a framework where the human-robot interaction is modeled as a multimodal dialogue which is regulated by an attentional system that guides the robot towards the execution of structured tasks. Specifically, we propose an approach where the dialogue between the human and the robot is represented as a Partially Obervable Markov Decision Process (POMDP), while the associated dialogue policy is enhanced by top-down attentional mechanisms that provide contextual and task-related contents. We introduce simple case studies that illustrate the system at work in different conditions considering top-down regulations and dialogue flows in synergistic and conflicting situations.

Flexible Task Execution and Attentional Regulations in Human-Robot Interaction

A robotic system that interacts with humans is expected to flexibly execute structured cooperative tasks while reacting to unexpected events and behaviors. In this paper, we face these issues presenting a framework that integrates cognitive control, executive attention, and hierarchical plan execution. In the proposed approach, the execution of structured tasks is guided by top-down (task-oriented) and bottom-up (stimuli-driven) attentional processes that affect behavior selection and activation, while resolving conflicts and decisional impasses. Specifically, attention is here deployed to stimulate the activations of multiple hierarchical behaviors orienting them toward the execution of finalized and interactive activities. On the other hand, this framework allows a human to indirectly and smoothly influence the robotic task execution exploiting attention manipulation. We provide an overview of the overall system architecture discussing the framework at work in different case studies. In particular, we show that multiple concurrent tasks can be effectively orchestrated and interleaved in a flexible manner; moreover, in a human-robot interaction setting, we test and assess the effectiveness of attention manipulation for interactive plan guidance.

Plan Execution and Attentional Regulations for Flexible Human-Robot Interaction

Flexible execution of structured tasks is a relevant issue in cognitive robotics and human-robot interaction. In this work, we address this problem presenting a framework that integrates planning and attentional regulations for flexible and interactive execution of human-robot cooperative tasks. In the proposed approach, attentional top-down and bottom-up mechanisms are deployed to guide the execution of generated hierarchical plans while managing conflicts and decisional impasses. We provide an overview of the proposed framework discussing the system at work in different scenarios. In particular, we focus on flexible execution of multiple plans and interactive plan execution guided by attentional manipulation.

Attentional multimodal interface for multidrone search in the Alps

We present a multimodal attentional interface suitable for a human operator that monitors and controls the activities of a team of drones during search and rescue missions. We consider a scenario where the operator is a component of the rescue team, hence not fully dedicated to the robots, but only able to interact with them with sparse and incomplete commands. In this context, an adaptive interface is needed to support the user situation awareness and to enable an effective interaction with the drones. In this work, we propose a multimodal attention-based interface designed for this domain. This framework is to filter the information flow towards the operator selecting and adapting the communication mode according to the context and the human state. We illustrate the features of the adaptive system along with an initial assessment in a simulated scenario.

Attentional supervision of human-robot collaborative plans

A human-robot interaction system should be capable of adapting the execution of cooperative plans with respect to complex human activities and interventions. In this paper, we present an integrated framework that exploits attentional supervision and contention scheduling to combine human-aware planning, plan execution, and natural human-robot interaction. Specifically, in the proposed approach, hierarchical cooperative plans are exploited as top-down attentional guidance for the robotic executive system, which can flexibly orchestrate the task activities while reacting to environmental stimuli and human behaviors. We describe the overall framework discussing some case studies in human-robot collaborative scenarios.

Attentional top-down regulation and dialogue management in human-robot interaction

We propose a framework where the human-robot interaction is modeled as a multimodal dialogue which is regulated by an attentional system that guides the system towards the execution of structured tasks. We introduce a simple case study to illustrate the system at work in different conditions considering top-down regulations and dialogue flows in synergic and conflicting situations.