Hicham Djenidi

Generic multimedia multimodal agents paradigms and their dynamic reconfiguration at the architectural level

The multimodal fusion for natural human-computer interaction involves complex intelligent architectures which are subject to the unexpected errors and mistakes of users. These architectures should react to events occurring simultaneously, and possibly redundantly, from different input media. In this paper, intelligent agent-based generic architectures for multimedia multimodal dialog protocols are proposed. Global agents are decomposed into their relevant components. Each element is modeled separately. The elementary models are then linked together to obtain the full architecture. The generic components of the application are then monitored by an agent-based expert system which can then perform dynamic changes in reconfiguration, adaptation, and evolution at the architectural level. For validation purposes, the proposed multiagent architectures and their dynamic reconfiguration are applied to practical examples, including a W3C application.

Generic Pipelined Multi-Agents Architecture for Multimedia Multimodal Software Environments.

Multimodal human-computer interaction needs intelligent architectures in order to enhance the flexibility and naturelness of the user interface. These architectures have the ability to manage several multithreaded input signals from different input media in order to perform their fusion into intelligent commands. In this paper, a generic comprehensive agent-based architecture for multimodal engine fusion is proposed. The architecture is sketched in term of its relevant components. Each element is modeled using timed colored Petri networks. The generic components of the engine fusion are then included in a pipelined based-agent global architecture for which the architectural quality attributes are outlined.

Agents paradigm to solve a complex optimization problem

Agents are computational systems interacting with dynamic, and non-entirely predictable environments. They decide for themselves, on the basis of their individual beliefs, goals, etc., how to respond to the environment. An agent is usually motivated to achieve a feasible objective by means of the collaboration of other agents. For example, lifting a heavy table may be impossible without help. However, it can be done by simply asking others for help. The process of gaining collaboration can take many forms. However, some tasks need more detailed communication to generate an explicit mutually acceptable agreement through negotiation. This paper presents a new method to solve the inverse kinematic problem of a redundant robot using the agents paradigm. This method guarantees rapid convergence of the robot to desired position, with substantially good accuracy. The originality of the proposed approach is its ability to overcome some of the standard problems such as the computation of the inverse or pseudoinverse Jacobian matrix, problem of singularity, redundancy, and considerably increased computational complexity, etc.

Dynamic multi-agent architecture for multimedia multimodal dialogs

There is a real need for clear and sound design specifications of dynamic architecture for multimedia multimodal dialogs. These specifications must take into account the dynamic aspect in order to satisfy quality attributes such as adaptability, maintainability and understandability. Multimodal systems featuring fusion for natural human-computer interaction involve complex intelligent architectures to handle unexpected errors and mistakes made by users. These architectures should react to events that occur simultaneously with eventual redundancy from different input media. In this paper, dynamic based intelligent agent architectures for multimedia multimodal dialog protocols are proposed Global agents are decomposed into relevant sub-agents, called components. Each sub-agent is modeled separately. Timed colored Petri nets are used to specify the structure and behavior of each agent in our architecture and to prove that this architecture satisfies the desired structural and behavioral properties. This paper describes work in progress and presents a sound idea of designing dynamic architecture using agents for multimedia applications.

Dynamic reconfiguration of multimodal architectures

The multimodal architectures should react to events occurring simultaneously, and possibly redundantly, from different input media. In this paper, intelligent expert agent-based architecture for multimedia multimodal dialog protocols is proposed. The generic components of the multimodal architecture are monitored by an expert agent, which can perform dynamic changes in reconfiguration, adaptation and evolution at the architectural level. Software performance and usability are maintained by the expert agent via a scenario-based methodology. The expert agents behavior modeled by Petri nets permits a software quality tradeoff between attributes of usability and other software attributes like systems performance.