Shih-Ping Liou

Videoabstract: a hybrid approach to generate semantically meaningful video summaries

Video summarization is a key component in providing Internet users a way to quickly browse a video clip in different levels of detail, without the need to view the entire video clip. We present a hybrid approach to video summary generation, which automatically process the video, creating a multimedia video summary, while providing easy-to-use interfaces for verification, correction, and augmentation of the automatically generated story segments and extracted multimedia content. Algorithms are developed to solve the sub-problems of story segmentation, story boundary refinement, and video summary generation. The use of automatic processing in conjunction with input from the user allows a user to produce meaningful video summaries efficiently.

A New Hybrid Approach to Video Organization for Content-Based Indexing

Video organization is a key step in the content-based indexing of video archives. The objective of video organization is to capture the semantic structure of a video in a form which is meaningful to the user. We present a hybrid approach to video organization which automatically processes video, creating a video table of contents (VTOC), while providing easy-to-use interfaces for verification, correction and augmentation of the automatically extracted video structure. Algorithms are developed to solve the sub-problems of shot detection, shot grouping and VTOC generation without making very restrictive assumptions about the structure or content of the video. We use a nonstationary time series model of difference metrics for shot boundary detection, color and edge similarities for shot grouping and observations about the structure of a wide class of videos for the generation of the VTOC. The use of automatic processing in conjunction with input from the user allows us to produce meaningful video organization efficiently.

Dynamic object markers in a collaborative environment for video content discussion

Discusses dynamic object marker generation and sharing in VideoTalk, a system for permitting different people from different places to share views about video content. We also discuss the criteria in designing a real-time, yet reliable, object tracking tool to be used in a collaborative environment, where the users are present throughout the discussion. We then propose a novel method for generating dynamic object markers providing the shape of the object in the starting frame and user feedback during the process. Our system can generate dynamic markers for an object and display them on the video display windows of the discussion participants in real time.