Ju-Chun Ko

Enabling beyond-surface interactions for interactive surface with an invisible projection

This paper presents a programmable infrared (IR) technique that utilizes invisible, programmable markers to support interaction beyond the surface of a diffused-illumination (DI) multi-touch system. We combine an IR projector and a standard color projector to simultaneously project visible content and invisible markers. Mobile devices outfitted with IR cameras can compute their 3D positions based on the markers perceived. Markers are selectively turned off to support multi-touch and direct on-surface tangible input. The proposed techniques enable a collaborative multi-display multi-touch tabletop system. We also present three interactive tools: i-m-View, i-m-Lamp, and i-m-Flashlight, which consist of a mobile tablet and projectors that users can freely interact with beyond the main display surface. Early user feedback shows that these interactive devices, combined with a large interactive display, allow more intuitive navigation and are reportedly enjoyable to use.

Multimedia feedback for improving breathing habit

Breathing is one of the most important functions in human body. Usually, people do not know enough about how to breathe. Therefore, we develop a system which can detect the userpsilas breathing status and assist him by multimedia. Our system allows a user to know their bodypsilas physical conditions and, through the multimedia interactive feedback of the sense, the user can check weather their physical conditions are normal. This physiological biofeedback system provides users an effective way to learn efficient breathing and emotional control, and finally it helps to improve physical and mental health. In this way, it can help the users to remain in relaxed condition most of the time. By combining smart clothing, interactive multimedia, and expert knowledge of medical research and clinics, we build a smart clothing system which can amend the userpsilas breathing habit, strengthen his immunity and improve his physical and mental health in a friendly and natural way.

QPalm: A gesture recognition system for remote control with list menu

The coming ubiquity of digital media content is driving the need of a solution for improving the interaction between the people and media. In this work, we proposed a novel interaction technique, QPalm, which allows the user to control the media via a list menu shown on a distant display by drawing circles in the air with one hand. To manipulate a list menu remotely, QPalm includes two basic functions, browse and choosing, realized by recognizing the userpsilas palm performing circular and push motions in the air. The circular motion provides fluidity in scrolling a menu up and down, while push motion is intuitive when the user decided to choose an item during a circular motion. Based on this design, we develop a vision system based on a stereo camera to track the userpsilas palm without interfering by intruders behind or next to the operating user. For more specifically, the contribution of the work includes: (1) an intuitive interaction technique, QPalm, for remote control with list menu, and (2) a palm tracking algorithm to support QPalm based on merely depth and motion information of images for a practical consideration.

Public issues on projected user interface

What will happen when pocket projectors become mainstream personal display channels? What will be affected when numerous projections intrude our living space without proper control? Todays technology in projection has promised a big screen viewing experience from mobile devices, pushing us toward a truly ubiquitous display environment. But, is our society prepared for the next projection-generation? We argue that the Projected user interface (PUI) will introduce new problems both in environmental and social aspects which are seldom been explored. This paper explores our rights to project and be projected in public space. Can we project on human body without asking for permission? Can we refuse to be projected? Can projection pollute the environment and influence the people therein? This paper proposes several issues about peoples rights on projection, and provide discussions on possible solutions.

Beyond the surface: 3D interactions for tabletop systems

Current tabletop systems are designed to sense 2D interactions taken place on the tabletop surface, such as finger touches and tangible objects. The ability to interact above the tabletop surface makes it possible to support 3D interactions. For example, an architect can examine a 2D blueprint of a building shown on the tabletop display while inspecting 3D views of the building by moving a mobile display above the tabletop. Recent approaches to localize objects in 3D requires visible markers or the use of embedded sensors [Song et al. 2009]. The use of visible markers often interferes with the content users are focusing on, limiting its usefulness and applicability.

Transformational breathing between present and past: virtual exhibition system of the mao-kung ting

The Mao-Kung Ting is one of the most precious artifacts in the National Palace Museum. Having five-hundred-character inscription cast inside, the Mao-Kung Ting is regarded as a very important historical document, dating back to 800 B.C.. Motivated by revealing the great nature of the artifact and interpreting it into a meaningful narrative, we have proposed an innovative Virtual Exhibition System to facilitate communication between the Mao-Kung Ting and audiences. Consequently, we develop the Virtual Exhibition system into the following scenarios: “Breathing through the History” and “View-dependent display”.