Dieter Metzing

Multidimensional markup and heterogeneous linguistic resources

The paper discusses two topics: firstly an approach of using multiple layers of annotation is sketched out. Regarding the XML representation this approach is similar to standoff annotation. A second topic is the use of heterogeneous linguistic resources (e.g., XML annotated documents, taggers, lexical nets) as a source for semi-automatic multi-dimensional markup to resolve typical linguistic issues, dealing with anaphora resolution as a case study.1

Integrated linguistic annotation models and their application in the domain of antecedent detection

Seamless integration of various, often heterogeneous linguistic resources in terms of their output formats and a combined analysis of the respective annotation layers are crucial tasks for linguistic research. After a decade of concentration on the development of formats to structure single annotations for specific linguistic issues, in the last years a variety of specifications to store multiple annotations over the same primary data has been developed. The paper focuses on the integration of the knowledge resource logical document structure information into a text document to enhance the task of automatic anaphora resolution both for the task of candidate detection and antecedent selection. The paper investigates data structures necessary for knowledge integration and retrieval.

Kommunizierende Agenten: Gestische und natürlichsprachliche Interaktion

SummaryAn important scientific method within cognitive science consists in the synthesis of cognitive abilities, of forms of behavior by developing specific artificial agents. Many current approaches make use of the notion of an agent in order to develop concepts of cognitive behavior on different levels of abstraction. Basic properties of agents are: reactivity, autonomy, goal directed activity, and communication. This contribution examines the communicative aspect, i.e. the interaction by gesture or language and their integration, e.g. in identifying referents. Since we conceive communicating agents as systems able to synthesize such interactions as well as their integration, this will be illustrated with respect to two artificial systems. The GRAVIS system detects objects as well as pointing gestures of an instructor, and the camera agent is able to focus on specific objects. The CoRA system processes situated natural language instructions, and the simulated robot agent is able to integrate the use of language, perception and action. Finally we propose an integration of both approaches.ZusammenfassungEin wichtiger Forschungsansatz innerhalb der Kognitionswissenschaft besteht in der Synthese kognitiver Fähigkeiten und Verhaltensweisen durch den Bau geeigneter, künstlicher Systeme. Viele der in jüngerer Zeit verfolgten Ansätze nutzen dabei den Begriff des Agenten, um kognitives Verhalten auf unterschiedlichen Abstraktionsebenen zu konzeptualisieren. Grundeigenschaften von Agenten sind u.a. Reaktivität, Autonomie, Zielgerichtetheit und Kommunikationsfähigkeit. In dem vorliegenden Beitrag interessieren wir uns für die Ebene kommunikativen Verhaltens, bei der Gestik und Sprache zur Vermittlung eines Sachverhaltes zusammenwirken, und verstehen unter einem kommunizierenden Agenten ein System, das für solches Verhalten einen nennenswerten Kompetenzausschnitt realisiert. Wir stellen hierzu beispielhaft zwei Systeme vor. Das System GRAVIS demonstriert die Referenzierung von Objekten im Blickfeld eines Kamerakopfes durch Handzeigegestik eines Instrukteurs. Das System CoRA demonstriert die Verarbeitung sprachlicher Handlungsanweisungen im Kontext der Kooperation mit einem simulierten Roboter. Abschließend wird die Integration der beiden Ansätze diskutiert.

Linguistic Information Modeling: From Kilivila Verb Morphology to RelaxNG

Summary. We will explore the role of an advanced type of document grammar, RelaxNG, in the context of different approaches to the formalization of linguistic regularities based on corpora and XML annotations. Our domain of exploration will be Kilivila verb morphology. The following topics will be focused on: Which kind of regularities in the domain can be expressed given formal limitations of document grammars, i.e. tree grammars? Which linguistic analyses may be taken as a basis for document grammar development? In which way can a document grammar be sensitive to properties of annotations and raw data (document validation and data validation)? Which kinds of formalization may be helpful in the (semi-automatic) development of a document grammar in the case explored? In the first part we will consider aspects of Kilivila verb morphology from the point of view of linguistic analyses. In the second part different strategies for the development of a RelaxNG based document grammar will be examined.

Communicating agents: Gesture and natural language interaction

SummaryAn important scientific method within cognitive science consists in the synthesis of cognitive abilities, of forms of behavior by developing specific artificial agents. Many current approaches make use of the notion of an agent in order to develop concepts of cognitive behavior on different levels of abstraction. Basic properties of agents are: reactivity, autonomy, goal directed activity, and communication. This contribution examines the communicative aspect, i.e. the interaction by gesture or language and their integration, e.g. in identifying referents. Since we conceive communicating agents as systems able to synthesize such interactions as well as their integration, this will be illustrated with respect to two artificial systems. The GRAVIS system detects objects as well as pointing gestures of an instructor, and the camera agent is able to focus on specific objects. The CoRA system processes situated natural language instructions, and the simulated robot agent is able to integrate the use of language, perception and action. Finally we propose an integration of both approaches.ZusammenfassungEin wichtiger Forschungsansatz innerhalb der Kognitionswissenschaft besteht in der Synthese kognitiver Fähigkeiten und Verhaltensweisen durch den Bau geeigneter, künstlicher Systeme. Viele der in jüngerer Zeit verfolgten Ansätze nutzen dabei den Begriff des Agenten, um kognitives Verhalten auf unterschiedlichen Abstraktionsebenen zu konzeptualisieren. Grundeigenschaften von Agenten sind u.a. Reaktivität, Autonomie, Zielgerichtetheit und Kommunikationsfähigkeit. In dem vorliegenden Beitrag interessieren wir uns für die Ebene kommunikativen Verhaltens, bei der Gestik und Sprache zur Vermittlung eines Sachverhaltes zusammenwirken, und verstehen unter einem kommunizierenden Agenten ein System, das für solches Verhalten einen nennenswerten Kompetenzausschnitt realisiert. Wir stellen hierzu beispielhaft zwei Systeme vor. Das System GRAVIS demonstriert die Referenzierung von Objekten im Blickfeld eines Kamerakopfes durch Handzeigegestik eines Instrukteurs. Das System CoRA demonstriert die Verarbeitung sprachlicher Handlungsanweisungen im Kontext der Kooperation mit einem simulierten Roboter. Abschließend wird die Integration der beiden Ansätze diskutiert.