Piotr Chynał

Using eyetracking in a mobile applications usability testing

In this paper we present general problems of a mobile application usability testing by means of eyetracking. The motivation for considering this problem is the fact that eyetracking is still one of the most advanced usability testing tool. We achieved that by performing two eyetracking tests with the participation of users. We tested mobile application on smartphone and PC emulator, to find out which method gives the most valuable results. Both tests showed that eyetracking testing of mobile applications gives valuable results but to make it really efficient professional equipment designed for mobile eyetracking is required.

Eye Tracking in Gesture Based User Interfaces Usability Testing

In the paper we present a method for usability evaluation of kinetic gesture based user interfaces with application of eye tracking. First we present the problems of the kinetic interaction and the application of eye tracking in usability studies. Then we present our method of the usability verification with applied eye tracking, by performing a sample experiment, then its results and discussion.

Comparison and analysis of the eye pointing methods and applications

In the paper we present comparison and analysis of the selected eye pointing methods and applications. Eye pointing enables communication with the computer system using human eye movements tracking. We analyze not only available eyetracking solutions but also those developed at our laboratory (i.e. ljo_gazetracker) are using specialized gazetracking devices. Those solutions were compared by means of series of experiments carried out with a group of users. These experiments showed that Dasher is the most effective gaze-writing application, and that ljo_gazetracker is the most precise eye pointing system. However, it needs application of quite sophisticated and pretty expensive technology. Thus Opengazer seems to be a good freeware alternative.

Remote usability testing using eyetracking

In the paper we present a low cost method of using eyetracking to perform remote usability tests on users. Remote usability testing enables to test users in their natural environment. Eyetracking is one of the most popular techniques for usability testing in the laboratory environment. We decided to try to use this technique in remote tests. We used standard web camera with freeware software. Our experiment showed that such method is not perfect, but it could be a good addition to the standard remote tests, and a foundation for further development.

Hybrid Approach to Web Based Systems Usability Evaluation

This paper presents a concept for a design of a new, hybrid method for web systems usability evaluation. This method will combine various elements of other, well-known usability methods, and will be enhanced with a mechanism to evaluate the use of the system, by the users, against the model of its desired use. This way it will be possible to determine the usability of a tested system, using various metrics and techniques, during a single test.

Statistical Verification of Remote Usability Testing Method

In this paper we present our approach to statistical verification of the proposed remote usability testing method based on data gathered from participants of the test. Remote usability testing is becoming more and more popular, because it allows to perform usability tests faster and cheaper than with traditional laboratory testing, while providing similar results. We have constructed a new, hybrid, usability testing method that allows to perform remote unmoderated usability evaluation of web-based systems. This method works as an application that is injected into the website web pages, and gathers data from its users while they are performing given tasks in the evaluated website. To verify the effectiveness of this method we have created a benchmark website with implemented specified number of different usability issues. After that we have performed an usability evaluation of that website using the hybrid method. We wanted to find out what percentage of the implemented usability issues will be found with this method with the specified number of participants. We assumed that the satisfactory percentage of found usability issues is 85% and we distinguished the number of participants of the remote usability test to obtain such threshold. The next step was to verify the statistical significance of obtained results. This paper presents an overview of the created method, the description of the performed experiment and statistical verification that was performed for the obtained data.

Application of Network Analysis in Website Usability Verification

This paper describes the application of network analysis in website usability verification. In particular we propose a new automatic usability testing method by means of application of network motifs analysis. In our method motifs are constructed according to the patterns of visited web-pages by particular users, which define the relationships between the pairs of users.

Eyetracking Evaluation of Different Chart Types Used for Web-Based System Data Visualization

This article presents a pilot study of evaluation of different chart types. We have prepared 33 charts together with corresponding tasks for participants, who were supposed to find some required information on them. During this process we have used an eyetracking device to record their gaze movements. This enabled us to observe how each chart was scanned by participants while looking for answers to the tasks. Furthermore, we analysed the correctness of their responses and their subjective ratings of the charts, in order to find designs that were the most suitable for different scenarios, such as comparing two values, presentation of large datasets etc.

Web-Systems Remote Usability Tests and Their Participant Recruitment

In this paper we present a description of a proposed hybrid, remote usability testing method and a comparison of different approaches to participant recruitment for the test conducted according to this usability evaluation method. Moreover this paper contains a description of the implemented hybrid method and its characteristic. One of the main features of this method is that it allows to perform remote online tests. These tests are an alternative to traditional laboratory tests. They don’t require a special laboratory space, gathering participants in one place, a moderator or other equipment to perform the tests. However we have to face a challenge – how to recruit participants for remote usability test, which is more complicated because we must motivate our users to participate in such test without having a direct contact with them.

Testing strategies for evaluation of user interfaces in SOA-based systems

This paper presents a research that was conducted to determine the best techniques and testing strategies for user interface evaluation of SOA-based systems. Although we can find many articles on, for example, the design of web services, few guidelines exist on user interfaces and their usability for SOA-based systems. To achieve our goal we have performed various tests to determine which evaluation techniques are most suitable for such systems. The tests were conducted on a system which was created at our university -- Platel. As a result we came up with a set of most effective techniques for user interface evaluation, and some guidelines for testing strategies, for SOA-based systems.