Richard Castanet

Automated Runtime Verification for Web Services

This paper presents a methodology to perform passive testing of behavioural conformance for the web services based on the security rule. The proposed methodology can be used either to check a trace (offline checking) or to runtime verification (online checking) with timing constraints, including future and past time. In order to perform this: firstly, we use the Nomad language to define the security rules. Secondly, we propose an algorithm that can check simultaneously multi instances. Afterwards, with each security rule, we propose a graphical statistics, with some fixed properties, that helps the tester to easy assess about the service. In addition to the theoretical framework we have developed a software tool, called RV4WS (Runtime Verification engine for Web Service), that helps in the automation of our passive testing approach. In particular the algorithm presented in this paper is fully implemented in the tool. We also present a mechanism to collect the observable trace in this paper.

WSOTF: An Automatic Testing Tool for Web Services Composition

This paper presents an automatic conformance testing tool with timing constraints from a formal specification (TEFSM: Timed Extended Finite State Machine) of web services composition (WSOTF: Web Service composition, Online Testing Framework), that is implemented by an online testing algorithm. This algorithm combines simultaneously idea of test execution and debug to generate and simultaneously execute the test cases. In this tool, the complete test scenario (timed test case suite and data) is built during test execution. This tool focus on unit testing, it means that only the service composition under test is tested and all its partners will be simulated by the WSOTF. This tool also considers the timing constraints and synchronous time delay. We can also use this tool for debug that is not easy while we develop a composite of Web services.

Integration of time in canonical testers for real-time systems

Testing a real-time system is not an easy thing, because the notion of time is not under control. In this paper, we present different formal models of specification that introduce time. We use one of these, the extended-time input-output state machine, to develop an algorithm to create a canonical tester which is used afterwards for producing test sequences with time.

Testing Web Services Composition Using the TGSE Tool

This paper proposes an approach to test (actively and passively) Web services composition described in BPEL using TGSE (Test Generation, Simulation and Emulation), that is a tool for generating test cases for Communicating Systems (CS). TGSE implements a generic generation algorithm allowing either test cases derivation or traces checking. It supports the description of one or several components with data and temporal constraints. First, in order to model the BPEL behaviors, the timing constraints, and data variables, the BPEL specification is transformed into the Timed Extended Finite State Machines (TEFSM) model. As our framework can handle both active and passive testing, on the one hand test cases are obtained by stimulating the CS. In this case, the exploration is guided by the use of test purposes modeled by TEFSM (a test purpose is considered as a part of the CS). On the other hand, TGSE can check whether a trace is valid according the specification or not. Finally, the Loan Web Service is used as a case study.

Testing of Web Services: Tools and Experiments

Web services are the element based in SOA (i.e., Service Oriented Architecture) applications that are commonly used in software systems. However the validation problem on quality of web services via testing has to be improved. This paper presents two tools for conformance testing of web services. One tool for unit testing that is implemented by an on-line approach. This tool can be used to test a web service-based and/or an orchestration by simulating its partners. The other focuses on verification of a timed trace with respect to a set of constraints. Specially, we can use this tool to verify on-line or off-line a timed trace. Finally, we show our experiments on a real-life case study, Product Retriever, by combining the two tools.

A Multi-service and Multi-protocol Validation Platform – Experimentation Results

This article presents the implementation of a validation platform based on formal methods and the experimental results obtained. This platform allows performing conformance and interoperability tests, analysing the specification and constructing a performance model for the services. It covers all stages of the validation which are: formal specification, test architecture definition, test generation and execution for the defined architecture, and performance evaluation. The test methods and architectures used here make it easier to detect and localise errors. The platform has been constructed within the framework of the RNRT (National Telecommunications Research Network) platform project, PLATONIS. This platform is composed of a network integrating the different sites of the project partners. The principal application domains for the platform are telecommunication systems and mobile telephony. In particular, two different cases study are presented that illustrate the platform’s applicability to the test of mobile 3rd generation protocols and services using WAP, GPRS and UMTS. Nevertheless, the platform is generic and can be used for other types of communication protocols and services.

Modeling and testing location based application in umts networks

This paper is concerned with design issues in telecommunications, using UMTS (Universal Mobile Telecommunications System) networks. We propose a modeling approach for basic service as location and for any applications written with languages as WML (Wireless Markup Language), for PDA (Personal Data Assistant)equipment (or User Equipment, which should be interpreted as mobile station). The models are intended for simulation and analysis in order to detect inconstancies and to design test patterns for implementations of UMTS network and user applications. In some case, we propose a technique to automatically generate test sequences from the model. These test sequences will be applied on a test architecture with comfonents as a mobile station (or UE), a gateway, a LCS (location services) Server and a HTTP server (or LCS Client) which includes application server and data base server. This research work is supported by a French national project, named Platonis.

Test case minimization for real-time systems using timed bound traces

Real-Time systems (RTS for short) are those systems whose behavior is time dependent. Reliability and safety are of paramount importance in designing and building RTS because a failure of an RTS puts the public and/or the environment at risk. For the purpose of effective error reporting and testing, this paper considers the trace inclusion problem for RTS: given a path ρ (resp. ρ′) of length n of a timed automaton A (resp. B), find whether the set of timed traces of ρ of length n are included in the set of timed traces of ρ′ of length n such that A is known but not B. We assume that the traces of ρ′ are only defined by a decision procedure. The proposed solution is based on the identification of a set of timed bound traces. The latter gives a finite representation of the trace space of a path. The number of these timed bounds varies between 1 and 2 × (n+1). The trace inclusion problem is then reduced to the inclusion of timed bound traces. The paper shows also how these results can be used to reduce the number of test cases for an RTS.

Une plate-forme de validation multi-protocoles et multi-services Résultats d’expérimentation

RésuméCet article présente la mise en œuvre et les résultats d’expérimentation d’une plate-forme de validation basée sur des méthodes formelles. Cette plate-forme permet de réaliser des tests de conformité et d’interopérabilité, d’analyser la QdS (Qualité de Service) et de produire un modèle de performance pour les services. Elle couvre toutes les étapes de validation: spécification formelle, définition des architectures de test, génération et exécution des tests sur une architecture donnée, et l’évaluation des performances. Les méthodes de test et les architectures présentées facilitent la détection et la localisation des erreurs.La plate-forme a été réalisée dans le cadre d’un projet plate-forme duRnrt (Réseau National de Recherche en Télécommunications),Platonis. Cette plate-forme possède une configuration réseau au niveau national avec des sites dans les laboratoires partenaires du projet.Les systèmes de télécommunications et la téléphonie mobile sont les domaines principaux d’application de la plate-forme. En particulier, deux études de cas sont présentées, celles-ci illustrent son application au test des protocoles et des services pour les réseaux cellulaires de 3e génération (utilisant leWap, gprs etUts). Mais il s’agit d’une plateforme générique qui pourra être utilisée pour d’autres types de services et protocoles de communication.AbstractThis article presents the implementation of a validation platform based on formal methods and the experimental results obtained. This platform allows performing conformance and interoperability tests, analysing the specification and constructing a performance model for the services. It covers all stages of the validation which are: formal specification, test architecture definition, test generation and execution for the defined architecture, and performance evaluation. The test methods and architectures used here make it easier to detect and localise errors. The platform has been constructed within the framework of theRnrt (National Telecommunications Research Network) platform project, platonis. This platform is composed of a network integrating the different sites of the project partners. The principal application domains for the platform are telecommunication systems and mobile telephony. In particular, two different cases study are presented that illustrate the platform’s applicability to the test of mobile 3rd generation protocols and services usingWap, gprs andUmts. Nevertheless, the platform is generic and can be used for other types of communication protocols and services.

Some operational tools in a OSI protocols study environment

This paper deals with a strategy for a development chain of protocols (specification, validation, conformity testing) based on knowledge of the RHIN project methodology and the tools which this project produced. This methodology is based on finite state machines with predicates and includes “conceptual” tools for specification (PDIL)and for validation (VADILOC). “Experimental” tools play a part in conformity testing (STQ, Cerbere, Genepi). The interaction between conceptual and experimental tools is provided by a test sequence generator GAST which, starting from an automaton whose communication has been validated, provides sequences to be used by the test tools.