Antti Jääskeläinen

Model-Based Testing Service on the Web

Model-based testing (MBT) seems to be technically superior to conventional test automation. However, MBT features some difficulties that can hamper its deployment in industrial contexts. We are developing a domain-specific MBT solution for graphical user interface (GUI) testing of Symbian S60 smartphone applications. We believe that such a tailor-made solution can be easier to deploy than ones that are more generic. In this paper, we present a service concept and an associated web interface that hide the inherent complexity of the test generation algorithms and large test models. The interface enables an easy-to-use MBT service based on the well-known keyword concept. With this solution, a better separation of concerns can be obtained between the test modeling tasks that often require special expertise, and test execution that can be performed by testers. We believe that this can significantly speed up the industrial transfer of model-based testing technologies, at least in this context.

Automatic GUI test generation for smartphone applications - an evaluation

We present the results of an evaluation where we studied the effectiveness of automatic test generation for graphical user interface (GUI) testing of smartphone applications. To describe the context of our evaluation, the tools and the test model library we have developed for the evaluation are also presented. The library contains test models for basic S60 applications, such as camera, contacts, etc. The tools include an on-line test generator that produces sequences of so called keywords to be executed on the test targets. In our evaluation, we managed to find over 20 defects from applications that had been on the market for several months. We also describe the problems we faced during the evaluation.

Synthesizing Test Models from Test Cases

In this paper we describe a methodology for synthesizing test models from test cases. The context of our approach is model-based graphical user interface (GUI) testing of smartphone applications. To facilitate the deployment of model-based testing practices, existing assets in test automation should be utilized. While companies are interested in the benefits of new approaches, they may have already invested heavily in conventional test suites. The approach presented in this paper enables using such suites for creating complex test models that should have better defect detection capability. The synthesis is illustrated with examples from two small case studies conducted using real test cases from industry. Our approach is semi-automatic requiring user interaction. We also outline planned tool support to enable efficient synthesis process.

Model-Based Testing Using System vs. Test Models - What Is the Difference?

We discuss the differences between using system models and test models with respect to the model-based testing process. Although these two terms are usually used interchangeably, very little is known about the distinction between the two. System models describe internal behavior of the system under test while the test models contain the behavior from user’s or environment’s point of view. We describe how these two types of models are obtained and used throughout the model-based testing process and how they are related to each other. The discussion is based on our earlier experiences as well as on two case study examples from the telecommunication domain.

Creating a Test Model Library for GUI Testing of Smartphone Applications (Short Paper)

Smartphones are becoming increasingly complex, and the interactions between the different applications make testing even more difficult given the time-to-market pressures and the limits of current test automation systems. Towards these ends, we have built an open source test model library for Symbian S60 GUI testing. This paper describes and analyzes our experiences in building the library.

Filtering test models to support incremental testing

Model-based testing can be hampered by the fact that a model depicting the system as designed does not necessarily correspond to the product as it is during development. Tests generated from such a model may be impossible to execute due to unimplemented features and already known errors. This paper presents a solution in which parts of the model can be filtered out and the remainder used to generate tests for the implemented portion of the product. In this way model-based testing can be used to gradually test the implementation as it becomes available. This is particularly important in incremental testing commonly used in industry.

Model-Based GUI Testing: Case Smartphone Camera and Messaging Development

Abstract Model-based software testing can be used to generate tests automatically from a formal model describing the system under test. Along with traditional test automation, it can improve the quality of testing and reduce the resources required for it. In this chapter, we will take a look at different approaches to model-based testing, examine its benefits and drawbacks, and analyze what adopting it would entail. The focus of the chapter is on graphical user interface (GUI) testing. We will also present a case study demonstrating the ability of a model-based testing tool to produce long-period tests and run tests on multiple smartphone devices in parallel.

A Comparison of Test Generation Algorithms for Testing Application Interactions

Testing the interactions of different applications running in the same operating system or platform poses challenges for manual testing and conventional script-based automation. Towards this end, we have developed an online model-based testing solution allowing efficient testing of such interactions. This paper presents the results of the comparison of algorithms used for generating tests for interaction testing. The comparison is based on our experiments with a number of different algorithms as well as results from the earlier studies by others. Given the simplicity of implementation, Random Walk seems very useful and practical solution for online test generation. However, each of the compared algorithms has its strong points, making the selection dependent of the metric one wants to emphasize and the available a priori information. Especially when the execution of test events is slow, smarter algorithms have advantage over simple random walk.

Towards Model Construction Based on Test Cases and GUI Extraction

The adoption of model-based testing techniques is hindered by the difficulty of creating a test model. Various techniques to automate the modelling process have been proposed, based on software process artefacts or an existing product. This paper outlines a hybrid approach to model construction, based on two previously proposed methods. The presented approach combines information in pre-existing test cases with a model extracted from the graphical user interface of the product.

Concurrent execution system for action languages

Traditional methods of managing concurrent processes are difficult and prone to errors. We propose that actions can provide a much simpler approach to the problem. In this paper, we use Temporal Logic of Actions to define an execution system that can be used to concurrently execute programs created with action languages. Important features of the system include naturally concurrent execution of actions, automated management of mutual exclusion, complete avoidance of low-level deadlocks, and implicit means of synchronization.