Guozhong Dai

Physical object icons buttons gesture (PIBG): a new interaction paradigm with pen

Pen-based User Interface (PUI) is becoming more and more popular. This paper presents (the) universal analysis and specification of characters and structure of PUI. PIBG, a new interaction paradigm, is proposed as the framework for PUI. PIBG Toolkit is also developed as a PUI Software Platform. With the goal of high usability, several applications are developed with PIBG Toolkit. PUI provides a method for natural and concordant interaction, which could facilitate the development and applications of collaborative systems.

A pen and speech-based storytelling system for Chinese children

Storytelling plays an important role in language learning. Storytelling by a child, as an educational activity, influences the childs linguistic ability, thought process, imagination, and creativity significantly. Many researchers have made extensive studies in storytelling systems for children. While there presently exist many software-based storytelling applications, most are deemed not completely suitable for Chinese children. In this paper, combining the characteristics of Chinese children and using the multimodal interaction pattern based on speech and pen-gesture, we present children a 3D storytelling system which uses user-centered scenario-based design method. The usability of the storytelling system is evaluated and the results suggest that all the users generally feel pretty satisfied with the system.

Pen-based user interface

Pen-based user interfaces are becoming more popular. This paper presents the universal analysis and specification of characters and structure of pen-based user interface. With the goal of high usability, interaction techniques on pen-based user interface are performed to improve the human-computer interaction. Furthermore, based on user-centered design, This work provides a natural and harmonious pen-based user interface for collaborative design, which enhances the development and application of collaborative system. The results of the survey provide insight of pen-based user interfaces and related applications.

Usability evaluation of children edutainment software

Owing to its educational content and entertainment model, edutainment software is getting widespread interest. Given the fast increasing popularity of the computer, edutainment software shows a promising prospect of extensive development. However, just like the HCI software, childrens edutainment software possesses the problem of usability. This paper, based on the study of usability evaluation methods, provides a scenario-based software evaluation method, and used the method to evaluate the Children Heaven edutainment software. Analysis of the evaluation results recognized the success of the software design. It also gives suggestions and comments for revising the software. The process of the evaluation experiments also verified the effectiveness of the scenario-based usability evaluation method for software.

PIGP: a pen-based intelligent dynamic lecture system for geometry teaching

Computer-based lecture presentation systems have been widely used in classroom. Yet the teachers can not edit the slides in class according to the actual classroom feedback, which goes against active learning. Although Ink annotation can to some extent make up for lack of interactions, the geometry teachers requirements for freely drawing graphics and showing dynamic geometric figures in class can not be met. We propose a pen-based intelligent dynamic lecture system for geometry teachers, with which teachers can not only add annotations with ink, but also demonstrate dynamic graphics with pen gestures and draw graphics with sketches. A kind of Rule-And-Context-Based mode switch method is adopted to intelligently speculate the users intentions to make sure that using Ink, Gesture and Sketch together do not confuse the users. An informal evaluation has been setup and the result seems quite positive.

A multimodal 3D storytelling system for Chinese children

storytelling by a child, as an educational activity, influences significantly the childs linguistic ability, thought process, imagination, and creativity. There presently exist many software-based storytelling applications. However, most are deemed not suitable to Chinese children due to various cultural and language barriers. In this paper, combining the characteristics of Chinese children and using the multimodal interaction pattern based on speech and pen-gesture, we present a 3D storytelling system for children. The usability of two versions of the storytelling system is evaluated. Evaluation results suggest version 2 of the system to be of higher usability, as are comments on revising the software.

A multimodal fusion framework for children's storytelling systems

Storytelling by a child, as a training activity, influences significantly a childs linguistic abilities, logic and thought process, imagination, and creativity. There presently exist many software-based storytelling applications. However, most are deemed incompatible or not suitable to Chinese children. Due to the limited vocabulary of pre-school and lower-level grade school children, speech-based and pen-based input models are considered the most effective way of input. But now there is not an effective multimodal mode to solve the problem for childrens storytelling systems. In this paper, we propose a multimodal fusion framework that utilizes pen and speech techniques to incorporate both context information and linguistic attributes of the Chinese language into the design. Based on the proposed framework, we formulated specific methods of integration, and developed a prototype for our proposed system.

Scenario-focused development method for a pen-based user interface: model and applications

AbstractnPen-based user interface (PUI) has drawn significant interest, owing to its intuitiveness and convenience. While much of the research focuses on the technology, the usability of a PUI has been relatively low since human factors have not been considered sufficiently. Scenario-centric designs are ideal ways to improve usability. However, such designs possess some problems in practical use. To cope with these design issues, the concept of “interface scenarios” is proposed in to facilitate the interface design, and to help users understand the interaction process in such designs. The proposed scenario-focused development method for PUI is coupled with a practical application to show its effectiveness and usability.n

A gesture language for collaborative conceptual design

Ubiquitous computing provides the new research challenges for the next generation interactions. Natural User Interface is one of the important aspects. Pen and paper are the natural and simple tools to use in our daily life, which can fit for the imprecise and flexible design mode in conceptual design. Gestures are the useful and natural mode in the pen-based interaction which can be introduced and used through the similar mode to the existing resources in interaction. Inherent problems exist with collaborative conceptual design because the simultaneous group interaction required for users to smoothly and effectively work together in the same virtual space. In this paper, we provide solutions to these problems by devising a fast and direct gesture-based user interface, a set of visual effects that better enable a users awareness of the operations done by other participants, and a set of tools for enhancing visual communication between participants. A gesture description language (GDL) is given to provide the useful gestures to the applications conveniently.

Research on network based conceptual design

Conceptual design has played a very important role in the design process. Knowledge of all the design requirements and constraints during this early phase of a products life cycle is usually approximate, imprecise, and unknown. Conceptual design is now recognized as a highly important process when considering both the concurrent engineering aspects and the commitment of resources necessary to design and develop a product. With the development of the Internet, collaborative design is imperative and effective. The technology of CSCW is adopted widely and necessarily in the domain of conceptual design. It can fit the nature of the design. It shortens the distance of designers in different places and collects and shares all the information in time. In conceptual design, collaborative design mainly includes function, principle, layout and initial structure, etc. We developed a system of conceptual design based on the current CAD system, which realized the seamless link with later detail design. For individual design, multi-modal technology, which integrates many interactions such as gesture and speech, supports an advanced interface to assist humans in developing applications.