Hajime Iwata

Method to improve accessibility of rich internet applications

Currently numerous websites contain dynamic content, but it is difficult to create accessible websites with dynamic content compared to those with static content. Because many platforms can realize Rich Internet Applications (RIAs), it is important that this type of dynamic content become accessible. We propose a method to improve accessibility of RIAs. Our method consists of two phases. In the first phase, we develop libraries to realize accessibility of RIAs. In the second phase, the libraries are automatically applied to RIAs. As an example of platforms that realize RIAs, our research focuses on JavaFX Script.

Support method of usability evaluations for android applications based on operation histories

Due to the prevalence of tablets, the usability of the User Interfaces (UIs) must be improved, but the number of support methods for usability evaluations for tablets is small. Herein we propose a method to automatically evaluate usability based on operation histories, including action frequency and operation times, and statistical analysis. Because our approach easily detects UI design problems, the burdens on developers and costs can be reduced. Using a small-scale case study and test with about 20 participants, we show that our approach can detect detailed problems with usability via a mostly automated process.

GUI prototype generation from scenarios in the requirements elicitation phase

In the requirements elicitation phase, operation flows of software are often defined by scenarios. It is necessary to define appropriate operation flows as scenarios in terms of easily comprehended operation flows, efficiency, etc. Then scenarios are implemented as software Graphical User Interfaces (GUIs). If the operation flows are defined inappropriately, the implemented GUIs may require modifications in the late software development phase. Although defining appropriate operation flows is difficult in the requirements elicitation phase, operation flows of GUIs cannot be always modified in the late software development phase. Thus, it is necessary for end users to evaluate the appropriateness of operation flows in scenarios. Herein we propose a method to generate GUI prototypes from scenarios. By parsing the events in the target scenarios, which are written in a natural language, GUI prototypes are automatically generated. Using the generated GUI prototypes, the appropriateness of operation flows can be evaluated by end users. If problems arise, the GUI prototypes can be modified in the early requirements elicitation phase.

Web accessibility support for visually impaired users using link content analysis

Web pages are used for a variety of purposes. End users must understand dynamically changing content and sequentially follow page links to find desired material, requiring significant time and effort. However, for visually impaired users using screen readers, it can be difficult to find links to web pages when link text and alternative text descriptions are inappropriate. Our method supports the discovery of content by analyzing 8 categories of link types, and allows visually impaired users to be aware of the content represented by links in advance. This facilitates end users access to necessary information on web pages. Our method of classifying web page links is therefore effective as a means of evaluating accessibility.

GUI Change Method according to Roles of Widgets and Change Patterns

To develop usable software, it is necessary to develop Graphical User Interfaces (GUIs) in iterative steps, such as evaluating the usability of GUIs and improving GUIs. In improving GUIs, developers are often required to modify both the GUI and the logic code of the software. In our research, to facilitate GUI improvement, we propose a method of automatically searching for code to be modified and suggesting how to modify them. To search for appropriate code to be modified, we define the roles of widgets according to their purpose and the patterns for how to change GUIs. In our method, how to change GUIs is specified, and then the parts of source programs that are required to be modified are searched for. Also, we classify methods for each widget according to their functions. Using this classification, a method of modifying the code that is searched for is suggested.

Automatic generation of tutorial systems from development specification

Recent complicated software functions have made it difficult for end users to operate them. Thus, it becomes important to learn how to operate them easily and effectively. Employing a tutorial system is the most suitable approach for learning how to operate software functions. A tutorial system demonstrates the how to operate using the actual software. As a result, end users can learn the usage as if they were actually using the software. However, development of tutorial systems requires much time and costs. Therefore, we propose a method of generating tutorial systems based on use case diagrams, sequence diagrams and test cases. In our method, a generated tutorial system shows function names extracted from use case diagrams, the how to operate along with sequence diagrams, and text string input and item selection using data from test cases. The generated tutorial system is then added to the source code for use in AOP (aspect-oriented programming).

Notification messages considering human centered design

Messages to notify users of application states (hereafter notification messages) such as error, warning, confirmation, and information messages are often used in user interfaces. Generally, error messages are the most critical, while information messages are the least. However, the types of notification messages are determined in terms of what the application can or cannot process successfully instead of what the users feel are the most critical issues. Currently, human centered design (HCD) focuses on users’ aspects. HCD emphasizes users in application development to realize a high usability. Thus, we propose a strategy to realize notification messages considering HCD. Concretely, we analyze existing notification messages in terms of the criticality level by users and define new types of notification messages. In addition, we develop guidelines to implement notification messages effectively. Our strategy allows users to be appropriately notified based on the criticality.

Automatic generation of an operation procedure presentation system reusing user's input data

Users use software applications to achieve a goal. Occasionally they make mistakes in the operation path due to the complexity of large-scale applications, which requires them to back track to the appropriate operation step and reenter previously input data. This is burdensome for users. Herein a method is proposed to generate an operation support system that reuses previously input data in an inappropriate operation path as much as possible by navigating users to the appropriate operation path. Specifically, our method has an input reuse function for copying previously input data to similar input items as well as an operation procedure presentation function to highlight the operation procedure from the current step to the goal. Our integrated operation support can minimize users’ rework. To generate our system, developers must create an ontology, including concepts of label names of input items, correspondence between input items and label names, an activity diagram of the target application, and the operation procedure. Our system uses this information to compute the similarity of label names between input items, copy input data for similar input items, and present operation procedures to users.

A Method for Converting Colors for Color-impaired People, Considering Saturation and Contrast Ratio

Because color-impaired people have difficulty in perceiving specific colors, colors used in documents must be converted for them. The colors of documents include the intentions of their designers. That is, designers use different colors for parts of the document that they want to be attractive or distinguishable in some way. In existing conversion methods, however, colors are not converted based on a consideration of the designers’ intentions. Hence, we propose a method for converting document colors for color-impaired people in a manner that takes the designers’ intentions into account. Here, we define the designers’ intentions as “attractiveness” and “distinguishability.” In our method, the original colors are classified into three levels, low, middle, and high, based on their saturation. In each saturation level, some colors are defined as available for conversion. Next, the original colors are converted to colors in the corresponding saturation levels. According to the RGB (red-green-blue) values of the original colors, the target colors for conversion can be specified. Then, the contrast ratios of the pair of foreground and background colors are calculated. If the contrast ratios do not satisfy the specific thresholds, the colors are additionally converted to other colors in the corresponding saturation levels. Finally, when the contrast ratios satisfy the specific thresholds, the conversion is complete.

Method to Generate an Operation Learning Support System by Shortcut Key Differences in Similar Software

Some software packages have the same purpose, but different operation methods. Users typically choose software that they find easier to operate. However, this is not always the case, and users may be confused by software operations in similar software packages. This study focuses on software shortcut keys. End users can operate software efficiently when they learn shortcut keys because they are independent of GUIs. Herein a learning operation support system is proposed to illustrate the difference in shortcut key functions between software packages. This system analyzes software manuals and source codes to extract shortcut key combinations and functions, and the results are color-coded displays of shortcut key combinations that carry out the same function by software package.