Sacha Reis

Model-based system testing of software product families

In software product family engineering reusable artifacts are produced during domain engineering and applications are built from these artifacts during application engineering. Modeling variability of current and future applications is the key for enabling reuse. The proactive reuse leads to a reduction in development costs and a shorter time to market. Up to now, these benefits have been realized for the constructive development phases, but not for testing. This paper presents the ScenTED technique (Scenario based TEst case Derivation), which aims at reducing effort in product family testing. ScenTED is a model-based, reuse-oriented technique for test case derivation in the system test of software product families. Reuse of test cases is ensured by preserving variability during test case derivation. Thus, concepts known from model-based testing in single system engineering, e.g., coverage metrics, must be adapted. Experiences with our technique gained from an industrial case study are discussed and prototypical tool support is illustrated.

Testing Variabilities in Use Case Models

The derivation of system test cases for product families is difficult due to variability in the requirements, since each variation point multiplies the number of possible behaviors to be tested. This paper proposes an approach to develop domain test cases from use cases that contain variabilities and to derive application test cases from them. The basic idea to avoid combinatorial explosion is to preserve the variability in domain test cases. New strategies to capture variability in test cases are suggested, which in combination help dealing with all basic types of variability in a use case and in its relationships (e.g., include >>).

Integration testing in software product line engineering: a model-based technique

The development process in software product line engineering is divided into domain engineering and application engineering. As a consequence of this division, tests should be performed in both processes. However, existing testing techniques for single systems cannot be applied during domain engineering, because of the variability in the domain artifacts. Existing software product line test techniques only cover unit and system tests. Our contribution is a model-based, automated integration test technique that can be applied during domain engineering. For generating integration test case scenarios, the technique abstracts from variability and assumes that placeholders are created for variability. The generated scenarios cover all interactions between the integrated components, which are specified in a test model. Additionally, the technique reduces the effort for creating placeholders by minimizing the number of placeholders needed to execute the integration test case scenarios. We have experimentally measured the performance of the technique and the potential reduction of placeholders.

Wiederverwendung von Integrationstestfällen in der Software-Produktlinienentwicklung

Zusammenfassung  Bei der Software-Produktlinienentwicklung ist der Entwicklungsprozess aufgeteilt in die Domänen- und die Applikationsentwicklung. Durch die Wiederverwendung von Testartefakten aus der Domänenentwicklung kann in der Applikationsentwicklung der Testaufwand signifikant reduziert werden. Existierende Ansätze zum Testen von Software-Produktlinien beschränken sich auf den Modul- und den Systemtest. In diesem Beitrag wird eine durchgängige und modellbasierte Technik für die automatisierte Ableitung von logischen Integrationstestfällen bei der Entwicklung von Software-Produktlinien vorgestellt. Die Technik umfasst sowohl die Generierung von wiederverwendbaren Integrationstestfällen in der Domänenentwicklung, als auch die Ableitung von Applikationstestfällen unter Wiederverwendung der Domänentestfälle. Mit Hilfe der wiederverwendbaren Integrationstestfälle wird zusätzlich bereits in der Domänenentwicklung ein frühzeitiger Test der Produktlinienplattform unterstützt. Durch quantitative Untersuchungen wurde sowohl die Anwendbarkeit als auch der potenzielle Nutzen der Technik evaluiert. AbstractThe development process in software product line engineering is divided into domain engineering and application engineering. The reuse of test artefacts from domain engineering can significantly reduce the test effort in application engineering. Existing approaches in testing software product lines focus on unit and system testing. In this paper an integrated and model-based technique for the automated generation of logical integration test cases for software product lines is presented. The technique includes the generation of reusable integration test cases in domain engineering as well as the derivation of application test cases by reusing the domain test cases. The reusable integration test cases additionally support an early test of the product line plattform in domain engineering. With quantitative measurements the applicability and the potential benefit of the technique have been evaluated.