John Z. Li

Modeling of moving objects in a video database

We introduce an innovative way to represent the trajectory of a single moving object and the relative spatio-temporal relations between multiple moving objects. The representation supports a rich set of spatial topological and directional relations. It also supports both quantitative and qualitative user queries about moving objects. Algorithms for matching trajectories and spatio-temporal relations of moving objects are designed to facilitate query processing. These algorithms can handle both exact and similarity matches. We also discuss the integration of our moving object model, based on a video model, in an object oriented system.

Modeling video temporal relationships in an object database management system

One of the key aspects of videos is the temporal relationship between video frames. In this paper we propose a tree-based model for specifying the temporal semantics of video data. We present a unique way of integrating our video model into an object database management system which has rich multimedia temporal operations. We further show how temporal histories are used to model video data, explore the video object base using object-oriented techniques. Such a seamless integration gives a uniform interface to end users. The integrated video object base management systems supports a broad range of temporal queries.

Modeling of video spatial relationships in an object database management system

A key aspect in video modeling is spatial relationships. We propose a spatial representation for specifying the spatial semantics of video data. Based on such a representation, a set of spatial relationships for salient objects is defined to support qualitative and quantitative spatial properties. The model captures both topological and directional spatial relationships. We present a novel way of incorporating this model into a video model, and integrating the abstract video model into an object database management system which has rich multimedia temporal operations. The integrated model is further enhanced by a spatial inference engine. The powerful expressiveness of our video model is validated by some query examples.

Spatial Reasoning Rules in Multimedia Management Systems.

In this paper we consider various spatial relationships that are of general interest for retrieving data from multimedia databases. We present a uni ed representation of spatial objects for both topological and directional relations. Such a representation is based on Allens temporal interval algebra. We also present a set of spatial inference rules, which allow us to make heterogeneous spatial relation deductions from existing directional and topological relations. For example, if we know A north of B, B overlap with C, and C north of D, then we deriveA above D. Since all the rules are propositional Horn clauses, they can be easily integrated into any multimedia database by using either a simple inference engine or a lookup table.

Modeling and querying multimedia data

Amidst the dramatic developments of computer technology in the last decades, we have seen a growing interest in supporting multimedia data. Compared with traditional data, the most noticeable features of multimedia data are their spatiality (the spatial layout of objects and their relationships), temporality (time-dependence in media such as video and audio), and presentation requirements (imposed in response to user queries, such as synchronization of different media). Developing database management support for multimedia data poses interesting challenges. Many multimedia database management systems have been developed to deal with these multimedia features. However, they suffer some common problems: lack of generality in media modeling, lack of precise knowledge of spatial information, limited spatio-temporal functionality, ineffective query languages, and inefficient query processing. The main purpose of this work is to investigate these problems and provide solutions. The first step of the research is to design a multimedia data model which is built upon and extends existing models. The proposed model is based on a temporal interval algebra. The establishment of a multimedia data model provides a theoretical foundation that is used to investigate multimedia query languages. The result is a general-purpose, object-oriented multimedia query language which supports content-based information retrieval. A prototype has been built to validate the proposed concepts.

Multimedia Extensions To Database Query Languages

Declarative query languages are an important feature of database management systems and have played an important role in their success. As database management technology enters the multimedia information system domain, the availability of query languages for multimedia applications will be equally important. However, one common problem with currently existing multimedia query languages is their lack of generality. They are designed either for a certain medium (e.g. images) or special applications (e.g., medical, geographical information systems). We describe general multimedia queries based on the ODMGs Object Query Language (OQL) and TIGUKAT Query Language (TQL). In order to capture the temporal and spatial relationships in multime-dia data, both OQL and TQL are extended by a set of multimedia primitives. These extended OQL and TQL also include functions for query presentation. We illustrate the extended language features by query examples.

Query Languages in Multimedia Database Systems

Declarative query languages are an important feature of database management systems and have played an important role in their success. As database management technology enters the multimedia information system area, the availability of special-purpose query languages for multimedia applications will be equally important. In this report 1 , we survey multimedia query languages and query models. Particularly, we look at those systems from the point of view of well-deened queries, fuzzy queries, visual queries, and query presentations. Several research issues, such as generic multimedia query languages, incremental queries, fuzzy queries, spatio-temporal queries, feature storage and organization, are also identiied. In our opinion these are vital issues for the success and development of a multimedia query language.

Video Modeling and Its Integration in a Temporal Object Model

Video modeling has become a topic of increasing interest in the area of multimedia research. One of the key aspects in the video medium is the temporal relationship between video frames. In this report1 we propose a tree-based model for specifying spatial and temporal semantics of video data. Our focus here is on the temporal issues. We present a unique way of integrating our video model into an objectbase management system which has rich multimedia temporal operations. We further show how temporal histories are used to model video data. Using histories to model video data is both simple and natural. It also can lead to a uniform behavioral model. A user can then explore the video objectbase using object-oriented techniques. Such a seamless integration gives a uniform interface to end users. The integrated video objectbase management system supports a broad range of temporal queries and is extensible, thus allowing the easy incorporation of new features into the system.

Modeling Video Spatial Relationships in an Object Model

Video modeling has become a topic of increasing interest in the area of multimedia research. One of the key aspects in the video medium is spatial relationships. In this paper we propose a spatial representation, based on the temporal interval algebra, for specifying the spatial semantics of video data. Based on such a representation, a set of comprehensive spatial relationships for salient objects are deened in supporting qualitative and quantitative spatial properties. Further, both topological and directional spatial relationships are captured within the proposed model. We present a novel way of incorporating the spatial model into a video model, called a common video object tree, and integrating the abstract video model into an objectbase management system which has rich multimedia temporal operations. The integrated video objectbase management system supports a broad range of spatial queries and is extensible, thus allowing the easy incorporation of new features into the system. Our focus here is in supporting diierent types of spatial queries including direct spatial queries, hybrid 1 spatial queries, complex spatial queries, computational spatial queries, and temporal spatial queries. The integrated model is further enhanced by a spatial inference engine. The powerful expressiveness of our video model are validated by many concrete query examples.

Modeling of Moving Objects in a Video Objectbase Management System

Modeling moving objects has become a topic of increasing interest in the area of video databases. Two key aspects of such modeling are object spatial and temporal relationships. In this paper we introduce an innovative way to represent the trajectory of single moving object and the relative spatio-temporal relations between multiple moving objects. The representation supports a rich set of spatial topological and directional relations. It also supports both quantitative and qualitative user queries about moving objects. Algorithms for matching trajectories and spatio-temporal relations of moving objects are designed to facilitate query processing. These algorithms can handle both exact and similarity matches. We also discuss the integration of our moving object model, based on a video model, in an object-oriented system. Some query examples are provided to further validate the expressiveness of our model.