Naomi M. Mitsumori

Business-process-driven gray-box SOA testing

Challenges are emerging in testing service-oriented architecture (SOA) systems. Current testing is not sufficient to deal with the new requirements arising from several SOA features such as composition, loose coupling, and code without a graphical user interface. The most critical architecture information of an SOA solution is actually how services are composed and interact with each other. This paper proposes a gray-box testing approach, that is, an approach that involves having access to internal workings, data structures, and algorithms when designing the test cases but tests at the user level as a black box, that is, by applying inputs and observing outputs. This approach leverages business processes and the underlying SOA layered architecture to better test SOA solutions. A commonly used language to model business processes is BPEL (Business Process Execution Language), which is the focus of the approach described in this paper. Among the layered artifacts, the business process view represents the global behavior of the SOA system and thus is a good candidate as supplemental architectural information to the functional requirement or specification in test-case design and generation. This approach has three key enablers: test-path exploration, trace analysis, and regression test selection. BPELTester is an innovative tool that implements this method. It has been piloted in several projects and the initial pilot results are presented in this paper.

Towards a practical and effective method for Web services test case generation

This paper proposes a method for Web services test case generation, which is centered on a practical test data generation framework that has higher probability to penetrate the service implementation logic. This presented framework leverages both the information contained in the WSDL/XSD files and the information provided by testers as well as enables testers to customize the fields to be tested, field constraints and data generation rules. The proposed method can generate test cases that are effective in detecting defects and efficient in reducing test time. This paper also presents preliminary empirical evidence to illustrate the value of the method.